Sep 05 20:42:18 devstack cinder-volume[76597]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 20:42:18 devstack cinder-volume[76597]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:42:18 devstack cinder-volume[76597]: we strongly recommend against using it for new projects. Sep 05 20:42:18 devstack cinder-volume[76597]: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:42:18 devstack cinder-volume[76597]: framework. For more detail see Sep 05 20:42:18 devstack cinder-volume[76597]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:42:18 devstack cinder-volume[76597]: import eventlet # noqa Sep 05 20:42:21 devstack cinder-volume[76597]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:42:21 devstack cinder-volume[76597]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:42:21 devstack cinder-volume[76597]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:42:22 devstack cinder-volume[76597]: INFO dbcounter [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Registered counter for database cinder Sep 05 20:42:22 devstack cinder-volume[76597]: DEBUG oslo_db.sqlalchemy.engines [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG dbcounter [-] [76597] Writer thread running {{(pid=76597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:42:23 devstack cinder-volume[76597]: INFO cinder.rpc [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 20:42:23 devstack cinder-volume[76597]: INFO cinder.rpc [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG oslo_db.sqlalchemy.engines [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:42:23 devstack cinder-volume[76597]: INFO cinder.volume.manager [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Determined volume DB was empty at startup. Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG cinder.volume.manager [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76597) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 20:42:23 devstack cinder-volume[76597]: INFO cinder.volume.manager [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 20:42:23 devstack cinder-volume[76597]: WARNING stevedore.named [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:42:23 devstack cinder-volume[76597]: WARNING castellan.key_manager [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:42:23 devstack cinder-volume[76597]: WARNING cinder.keymgr.conf_key_mgr [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG cinder.volume.drivers.lvm [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76597) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG oslo_concurrency.processutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG oslo_concurrency.processutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] CMD "cinder-rtstool verify" returned: 0 in 0.429s {{(pid=76597) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG oslo_db.sqlalchemy.engines [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:42:23 devstack cinder-volume[76597]: INFO cinder.rpc [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 05 20:42:23 devstack cinder-volume[76597]: INFO cinder.rpc [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 05 20:42:23 devstack cinder-volume[76597]: WARNING stevedore.named [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:42:23 devstack cinder-volume[76597]: WARNING castellan.key_manager [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:42:23 devstack cinder-volume[76597]: INFO cinder.volume.manager [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 05 20:42:23 devstack cinder-volume[76597]: DEBUG oslo_db.sqlalchemy.engines [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76597) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:42:24 devstack cinder-volume[76597]: INFO oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Starting 1 workers Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Started child 76765 {{(pid=76597) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Full set of CONF: {{(pid=76597) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] ******************************************************************************** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Configuration options gathered from: {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] ================================================================================ {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] allow_availability_zone_fallback = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] allow_compression_on_image_upload = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76765]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] allowed_direct_url_schemes = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] api_rate_limit = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] auth_strategy = keystone {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] az_cache_duration = 3600 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_availability_zone = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_host = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_stats_polling_interval = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backup_api_class = cinder.backup.api.API {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backup_name_template = backup-%s {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backup_use_same_host = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backup_use_temp_snapshot = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] chap_password = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] chap_username = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_internal_tenant_project_id = f7f7019426374bddb6308e52884ef70a {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_internal_tenant_user_id = 14822ec627734a509f649621886bca32 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cloned_volume_same_az = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cluster = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] compression_format = gzip {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] compute_api_class = cinder.compute.nova.API {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] config_dir = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] config_source = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] control_exchange = openstack {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] debug = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] default_availability_zone = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] default_group_type = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] default_volume_type = lvmdriver-1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] disk_geometry = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] driver_client_cert = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] driver_client_cert_key = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] driver_data_namespace = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] driver_ssl_cert_path = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] driver_ssl_cert_verify = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] driver_use_ssl = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] enable_force_upload = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] enable_new_services = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] enable_unsupported_driver = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] enforce_multipath_for_image_xfer = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] filter_function = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_api_insecure = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_api_ssl_compression = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_ca_certificates_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_catalog_info = image:glance:publicURL {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_num_retries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance_request_timeout = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] goodness_function = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] graceful_shutdown_timeout = 5 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] group_api_class = cinder.group.api.API {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] host = devstack {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_compress_on_upload = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_conversion_address_space_limit = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_conversion_cpu_limit = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_conversion_disable = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_upload_use_cinder_backend = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_upload_use_internal_tenant = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_volume_cache_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_volume_cache_max_count = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] image_volume_cache_max_size_gb = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] init_host_max_objects_retrieval = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] instance_format = [instance: %(uuid)s] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] iscsi_target_flags = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] iscsi_write_cache = on {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] iser_helper = tgtadm {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] iser_ip_address = 192.168.122.117 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] iser_port = 3260 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_color = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_config_append = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_dir = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_options = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_rotate_interval = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_rotate_interval_type = days {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] log_rotation_type = none {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] max_age = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] max_logfile_count = 30 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] max_logfile_size_mb = 200 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] max_over_subscription_ratio = 20.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] message_reap_interval = 86400 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] message_ttl = 2592000 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] migration_create_volume_timeout_secs = 300 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] monkey_patch = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] monkey_patch_modules = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] my_ip = 192.168.122.117 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] no_snapshot_gb_quota = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] num_iser_scan_tries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] num_shell_tries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] num_volume_device_scan_tries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] nvmeof_conn_info_version = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] nvmet_ns_id = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] nvmet_port_id = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] osapi_max_limit = 1000 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] osapi_volume_ext_list = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] osapi_volume_listen_port = 8776 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] osapi_volume_use_ssl = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] osapi_volume_workers = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] per_volume_size_limit = -1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] periodic_fuzzy_delay = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] periodic_interval = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] public_endpoint = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] publish_errors = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] quota_backup_gigabytes = 1000 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] quota_backups = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] quota_gigabytes = 1000 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] quota_groups = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] quota_snapshots = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] quota_volumes = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] rate_limit_burst = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] rate_limit_except_level = CRITICAL {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] rate_limit_interval = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] reinit_driver_count = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] replication_device = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] report_discard_supported = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] report_interval = 120 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] reservation_clean_interval = 86400 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] reservation_expire = 86400 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] reserved_image_namespaces = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] reserved_percentage = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] rpc_response_timeout = 120 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] run_external_periodic_tasks = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] scst_target_driver = iscsi {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] scst_target_iqn_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_down_time = 720 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] shell_completion = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] snapshot_name_template = snapshot-%s {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] snapshot_same_host = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] split_loggers = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] state_path = /opt/stack/data/cinder {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] storage_availability_zone = nova {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] storage_protocol = iSCSI {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] syslog_log_facility = LOG_USER {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] target_helper = lioadm {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] target_ip_address = 192.168.122.117 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] target_port = 3260 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] target_protocol = iscsi {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] target_secondary_ip_addresses = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] trace_flags = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] transport_url = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] until_refresh = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] use_chap_auth = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] use_default_quota_class = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] use_journal = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] use_json = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] use_multipath_for_image_xfer = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] use_stderr = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] use_syslog = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] verify_glance_signatures = enabled {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_api_class = cinder.volume.api.API {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_backend_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_clear = zero {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_clear_ionice = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_clear_size = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_copy_bps_limit = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_dd_blocksize = 1M {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_name_template = volume-%s {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_service_inithost_offload = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volume_usage_audit_period = month {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] zoning_mode = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_concurrency.disable_process_locking = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.auth_section = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.auth_type = password {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.auth_version = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.cache = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.include_service_catalog = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.insecure = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.interface = public {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_password = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcache_username = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.region_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.service_type = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.backend = dogpile.cache.null {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.backend_argument = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.backend_expiration_time = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.config_prefix = cache.oslo {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.debug_cache_backend = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.enable_retry_client = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.enable_socket_keepalive = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.expiration_time = 600 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.hashclient_retry_attempts = 2 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.memcache_dead_retry = 300 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.memcache_pool_maxsize = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.memcache_sasl_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.password = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.proxies = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.redis_db = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.redis_server = localhost:6379 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.retry_attempts = 2 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.retry_delay = 0.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.socket_keepalive_count = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.socket_keepalive_idle = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.socket_keepalive_interval = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.socket_timeout = 1.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.tls_allowed_ciphers = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.tls_cafile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.tls_certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.tls_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.tls_keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cache.username = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] coordination.backend_url = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.asyncio_connection = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.asyncio_slave_connection = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.backend = sqlalchemy {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.connection = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.connection_debug = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.connection_parameters = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.connection_recycle_time = 3600 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.connection_trace = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.db_inc_retry_interval = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.db_max_retries = 20 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.db_max_retry_interval = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.db_retry_interval = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.max_overflow = 50 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.max_pool_size = 5 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.max_retries = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.mysql_wsrep_sync_wait = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.pool_timeout = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.retry_interval = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.slave_connection = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.sqlite_synchronous = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.synchronous_reader = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] database.use_db_reconnect = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_tracing.insecure = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.connection_string = messaging:// {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.es_doc_type = notification {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.es_scroll_size = 10000 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.es_scroll_time = 2m {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.filter_error_trace = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.hmac_keys = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.sentinel_service_name = mymaster {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.socket_timeout = 0.1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.trace_requests = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler.trace_sqlalchemy = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler_jaeger.process_tags = {} {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler_jaeger.service_name_prefix = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] profiler_otlp.service_name_prefix = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.enforce_new_defaults = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.policy_default_rule = default {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.policy_file = policy.yaml {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] privsep_osbrick.group = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] privsep_osbrick.helper_command = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] privsep_osbrick.user = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_sys_admin.group = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_sys_admin.helper_command = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] cinder_sys_admin.user = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.auth_section = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.auth_type = password {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.cafile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.collect_timing = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.insecure = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.send_service_user_token = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.split_loggers = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.timeout = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.tls_ciphers = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] service_user.tls_min_version = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.auth_section = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.auth_type = password {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.collect_timing = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.insecure = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.region_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.split_loggers = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.timeout = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.tls_ciphers = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] glance.tls_min_version = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.backend_availability_zone = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.chap_password = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.chap_username = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.disk_geometry = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.driver_client_cert = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.driver_client_cert_key = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.driver_data_namespace = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.driver_use_ssl = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.extra_capabilities = {} {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.filter_function = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.goodness_function = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.iscsi_target_flags = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.iscsi_write_cache = on {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.iser_helper = tgtadm {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.iser_port = 3260 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.lvm_share_target = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.lvm_type = auto {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.num_shell_tries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.replication_device = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.report_discard_supported = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.reserved_percentage = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.target_helper = tgtadm {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.target_port = 3260 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.target_protocol = iscsi {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.trace_flags = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.unique_fqdn_network = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.use_chap_auth = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_backend_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_clear = zero {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_clear_ionice = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_clear_size = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_reports.file_event_handler = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_reports.log_dir = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.backend_host = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.chap_password = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.chap_username = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.disk_geometry = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.driver_client_cert = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.extra_capabilities = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.filter_function = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.goodness_function = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.iser_helper = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.iser_ip_address = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.iser_port = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.lvm_share_target = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.lvm_type = auto {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.num_shell_tries = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.replication_device = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.report_discard_supported = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.reserved_percentage = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.scst_target_driver = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.storage_protocol = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.target_helper = lioadm {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.target_ip_address = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.target_port = 3260 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.trace_flags = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.use_chap_auth = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_clear = zero {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_clear_size = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] lvmdriver-1.volumes_dir = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.ssl = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_notifications.driver = [] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_notifications.retry = -1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] key_manager.fixed_key = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.barbican_api_version = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.barbican_endpoint = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.barbican_endpoint_type = public {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.barbican_region_name = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.cafile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.collect_timing = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.insecure = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.number_of_retries = 60 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.retry_delay = 1 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.send_service_user_token = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.split_loggers = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.timeout = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.tls_ciphers = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.tls_min_version = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.verify_ssl = True {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican.verify_ssl_path = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.auth_section = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.auth_type = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.cafile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.certfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.collect_timing = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.insecure = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.keyfile = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.split_loggers = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.timeout = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.tls_ciphers = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] barbican_service_user.tls_min_version = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.approle_role_id = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.approle_secret_id = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.auth_method = approle {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.auth_path = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.kv_mountpoint = secret {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.kv_path = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.kv_version = 2 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.namespace = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.root_token_id = **** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.ssl_ca_crt_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.timeout = 60.0 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.token_file = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.token_role = None {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.use_ssl = False {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:42:24 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] ******************************************************************************** {{(pid=76597) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 20:42:24 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.388s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:24 devstack sudo[76904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:24 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:24 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.315s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:42:24 devstack cinder-volume[76765]: INFO cinder.brick.local_dev.lvm [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:24 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:24 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:42:24 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:25 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:25 devstack cinder-volume[76765]: DEBUG cinder.brick.local_dev.lvm [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76765) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 05 20:42:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:25 devstack sudo[77088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:25 devstack sudo[77088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:25 devstack sudo[77088]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.547s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:25 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:25 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:25 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:26 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:26 devstack sudo[77381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 05 20:42:26 devstack sudo[77381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:26 devstack sudo[77381]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.253s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:26 devstack sudo[77384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:42:26 devstack sudo[77384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:26 devstack sudo[77384]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.365s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:26 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:26 devstack sudo[77468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:42:26 devstack sudo[77468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:27 devstack sudo[77468]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:27 devstack sudo[77473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:42:27 devstack sudo[77473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:27 devstack sudo[77473]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.380s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:27 devstack sudo[77560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:27 devstack sudo[77560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:27 devstack sudo[77560]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:27 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:27 devstack sudo[77564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:27 devstack sudo[77564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:28 devstack sudo[77564]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:28 devstack cinder-volume[76765]: INFO cinder.volume.drivers.lvm [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:28 devstack sudo[77568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:28 devstack sudo[77568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:28 devstack sudo[77568]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:28 devstack sudo[77577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:42:28 devstack sudo[77577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:28 devstack sudo[77577]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:28 devstack sudo[77580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:42:28 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:28 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:28 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:28 devstack sudo[77583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:28 devstack sudo[77583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:29 devstack sudo[77583]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:29 devstack sudo[77586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:42:29 devstack sudo[77586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:29 devstack sudo[77586]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:29 devstack cinder-volume[76765]: INFO cinder.volume.driver [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Driver hasn't implemented _init_vendor_properties() Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG cinder.volume.driver [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76765) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG oslo_db.sqlalchemy.engines [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76765) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writer thread running {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG cinder.db.api [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Building query based on filter {{(pid=76765) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG cinder.image.image_utils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76765) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 20:42:29 devstack cinder-volume[76765]: INFO cinder.keymgr.migration [None req-a69bf27d-6caf-4d01-9c1e-bf4151e4c106 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:42:29 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:29 devstack sudo[77591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:42:29 devstack sudo[77591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:30 devstack sudo[77591]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:30 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:30 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:30 devstack sudo[77594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:42:30 devstack sudo[77594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:30 devstack sudo[77594]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:30 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:30 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:30 devstack sudo[77599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:30 devstack sudo[77599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:30 devstack sudo[77599]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:30 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:30 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:30 devstack sudo[77603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:42:30 devstack sudo[77603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:31 devstack sudo[77603]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:42:31 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Driver initialization completed successfully. Sep 05 20:42:31 devstack cinder-volume[76765]: INFO cinder.manager [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Initiating service 2 cleanup Sep 05 20:42:31 devstack cinder-volume[76765]: INFO cinder.manager [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Service 2 cleanup completed. Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG cinder.service [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Creating RPC server for service cinder-volume {{(pid=76765) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG cinder.service [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76765) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 20:42:31 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:31 devstack sudo[77606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:42:31 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:31 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:31 devstack sudo[77609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:42:31 devstack sudo[77609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:31 devstack sudo[77609]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:31 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:31 devstack sudo[77615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:42:31 devstack sudo[77615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:32 devstack sudo[77615]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:32 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:32 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:42:32 devstack sudo[77621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:42:32 devstack sudo[77621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:42:32 devstack sudo[77621]: pam_unix(sudo:session): session closed for user root Sep 05 20:42:32 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:42:32 devstack cinder-volume[76765]: INFO cinder.volume.manager [None req-51e3855a-a2bf-4736-bc06-c0a1f950dc2e None None] Driver post RPC initialization completed successfully. Sep 05 20:42:34 devstack cinder-volume[76597]: DEBUG dbcounter [-] [76597] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76597) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:42:42 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=3 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:42:42 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:43:21 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running periodic task VolumeManager._thread_info {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:43:21 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] thread count: 6 {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:43:21 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] thread info: [<_MainThread(MainThread, started 126752473297024)>, , , , , ] {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:44:21 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:44:21 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:44:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:21 devstack sudo[82845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:44:21 devstack sudo[82845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:21 devstack sudo[82845]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:21 devstack sudo[82848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:44:21 devstack sudo[82848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:21 devstack sudo[82848]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:21 devstack sudo[82851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:44:21 devstack sudo[82851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:22 devstack sudo[82851]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:44:22 devstack sudo[82854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:44:22 devstack sudo[82854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:44:22 devstack sudo[82854]: pam_unix(sudo:session): session closed for user root Sep 05 20:44:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:44:22 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:44:22 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running periodic task VolumeManager._thread_info {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:44:22 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] thread count: 6 {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:44:22 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] thread info: [<_MainThread(MainThread, started 126752473297024)>, , , , , ] {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:44:42 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:45:21 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:45:21 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:45:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:21 devstack sudo[84484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:45:21 devstack sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:21 devstack sudo[84484]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:21 devstack sudo[84496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:45:21 devstack sudo[84496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:21 devstack sudo[84496]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:21 devstack sudo[84500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:45:21 devstack sudo[84500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:22 devstack sudo[84500]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:45:22 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:45:22 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:45:22 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Sep 05 20:45:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:45:22 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:45:22 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running periodic task VolumeManager._thread_info {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:45:22 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] thread count: 6 {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:45:22 devstack cinder-volume[76765]: DEBUG cinder.volume.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] thread info: [<_MainThread(MainThread, started 126752473297024)>, , , , , ] {{(pid=76765) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:46:21 devstack cinder-volume[76765]: DEBUG oslo_service.periodic_task [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76765) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:46:21 devstack cinder-volume[76765]: DEBUG cinder.volume.drivers.lvm [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Updating volume stats {{(pid=76765) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 05 20:46:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:21 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 05 20:46:21 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:21 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:21 devstack sudo[85908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:46:21 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:21 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:21 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:21 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 05 20:46:21 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:22 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:46:22 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 05 20:46:22 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:46:22 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Sep 05 20:46:22 devstack cinder-volume[76765]: DEBUG oslo_concurrency.processutils [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76765) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:46:22 devstack cinder-volume[76765]: DEBUG cinder.manager [None req-653ed9d2-d71c-451e-962f-d283029fc3d3 None None] Notifying Schedulers of capabilities ... {{(pid=76765) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:46:42 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:SELECT=1 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:46:42 devstack cinder-volume[76765]: DEBUG dbcounter [-] [76765] Writing DB stats cinder:UPDATE=1 {{(pid=76765) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:46:59 devstack cinder-volume[76597]: INFO oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Caught SIGTERM, stopping children Sep 05 20:46:59 devstack cinder-volume[76597]: DEBUG oslo_concurrency.lockutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Acquiring lock "singleton_lock" {{(pid=76597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:46:59 devstack cinder-volume[76597]: DEBUG oslo_concurrency.lockutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Acquired lock "singleton_lock" {{(pid=76597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:46:59 devstack cinder-volume[76597]: DEBUG oslo_concurrency.lockutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Releasing lock "singleton_lock" {{(pid=76597) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:46:59 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Stop services. {{(pid=76597) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 20:46:59 devstack cinder-volume[76597]: DEBUG oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Killing children. {{(pid=76597) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 20:46:59 devstack cinder-volume[76597]: INFO oslo_service.backend._eventlet.service [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Waiting on 1 children to exit Sep 05 20:47:04 devstack cinder-volume[76765]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 05 20:47:05 devstack cinder-volume[86779]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 20:47:05 devstack cinder-volume[86779]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:47:05 devstack cinder-volume[86779]: we strongly recommend against using it for new projects. Sep 05 20:47:05 devstack cinder-volume[86779]: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:47:05 devstack cinder-volume[86779]: framework. For more detail see Sep 05 20:47:05 devstack cinder-volume[86779]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:47:05 devstack cinder-volume[86779]: import eventlet # noqa Sep 05 20:47:06 devstack cinder-volume[76765]: DEBUG oslo_concurrency.lockutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Acquiring lock "singleton_lock" {{(pid=76765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:47:06 devstack cinder-volume[76765]: DEBUG oslo_concurrency.lockutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Acquired lock "singleton_lock" {{(pid=76765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:47:06 devstack cinder-volume[76765]: DEBUG oslo_concurrency.lockutils [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Releasing lock "singleton_lock" {{(pid=76765) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:47:06 devstack cinder-volume[76765]: WARNING amqp [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:47:06 devstack cinder-volume[76765]: WARNING amqp [None req-1c84508e-73f9-4157-8975-6776f15d2e45 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:47:07 devstack cinder-volume[86779]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:47:07 devstack cinder-volume[86779]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:47:07 devstack cinder-volume[86779]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:47:08 devstack cinder-volume[86779]: INFO dbcounter [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Registered counter for database cinder Sep 05 20:47:08 devstack cinder-volume[86779]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:08 devstack cinder-volume[86779]: DEBUG dbcounter [-] [86779] Writer thread running {{(pid=86779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:47:08 devstack cinder-volume[86779]: INFO cinder.rpc [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 20:47:08 devstack cinder-volume[86779]: INFO cinder.rpc [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 20:47:08 devstack cinder-volume[86779]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:08 devstack cinder-volume[86779]: INFO cinder.volume.manager [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Determined volume DB was empty at startup. Sep 05 20:47:08 devstack cinder-volume[86779]: DEBUG cinder.volume.manager [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86779) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 20:47:08 devstack cinder-volume[86779]: INFO cinder.volume.manager [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 05 20:47:08 devstack cinder-volume[86779]: WARNING stevedore.named [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:47:08 devstack cinder-volume[86779]: WARNING castellan.key_manager [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:47:08 devstack cinder-volume[86779]: WARNING cinder.keymgr.conf_key_mgr [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:47:08 devstack cinder-volume[86779]: INFO cinder.volume.manager [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:09 devstack cinder-volume[86779]: INFO oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Starting 1 workers Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Started child 87022 {{(pid=86779) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Full set of CONF: {{(pid=86779) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] ******************************************************************************** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Configuration options gathered from: {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] ================================================================================ {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] allow_availability_zone_fallback = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] allow_compression_on_image_upload = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] allowed_direct_url_schemes = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] api_rate_limit = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] auth_strategy = keystone {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_availability_zone = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_host = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_stats_polling_interval = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backup_api_class = cinder.backup.api.API {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backup_name_template = backup-%s {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backup_use_same_host = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backup_use_temp_snapshot = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] chap_password = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] chap_username = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_internal_tenant_project_id = f7f7019426374bddb6308e52884ef70a {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[87022]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_internal_tenant_user_id = 14822ec627734a509f649621886bca32 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cluster = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] compression_format = gzip {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] compute_api_class = cinder.compute.nova.API {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] config_dir = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] config_source = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] control_exchange = openstack {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] debug = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] default_availability_zone = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] default_group_type = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] default_volume_type = QuobyteHD {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] disk_geometry = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] driver_client_cert = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] driver_client_cert_key = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] driver_data_namespace = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] driver_ssl_cert_path = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] driver_ssl_cert_verify = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] driver_use_ssl = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] enable_new_services = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] enable_unsupported_driver = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] enabled_backends = ['QuobyteHD'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] enforce_multipath_for_image_xfer = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] filter_function = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_api_insecure = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_api_ssl_compression = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_ca_certificates_file = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_catalog_info = image:glance:publicURL {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_num_retries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance_request_timeout = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] goodness_function = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] graceful_shutdown_timeout = 5 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] group_api_class = cinder.group.api.API {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] host = devstack {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_compress_on_upload = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_conversion_address_space_limit = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_conversion_cpu_limit = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_conversion_disable = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_upload_use_cinder_backend = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_upload_use_internal_tenant = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_volume_cache_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_volume_cache_max_count = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] image_volume_cache_max_size_gb = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] init_host_max_objects_retrieval = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] instance_format = [instance: %(uuid)s] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] iscsi_target_flags = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] iscsi_write_cache = on {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] iser_helper = tgtadm {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] iser_ip_address = 192.168.122.117 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] iser_port = 3260 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_color = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_config_append = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_dir = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_file = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_options = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_rotate_interval = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_rotate_interval_type = days {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] log_rotation_type = none {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] max_age = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] max_logfile_count = 30 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] max_logfile_size_mb = 200 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] max_over_subscription_ratio = 20.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] message_reap_interval = 86400 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] message_ttl = 2592000 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] migration_create_volume_timeout_secs = 300 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] monkey_patch = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Starting volume driver QuobyteDriver (1.2) Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] monkey_patch_modules = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] my_ip = 192.168.122.117 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] no_snapshot_gb_quota = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] num_iser_scan_tries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] num_shell_tries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] num_volume_device_scan_tries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] nvmeof_conn_info_version = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] nvmet_ns_id = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] nvmet_port_id = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] osapi_max_limit = 1000 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] osapi_volume_ext_list = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.remotefs [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87022) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] osapi_volume_listen_port = 8776 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] osapi_volume_use_ssl = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] osapi_volume_workers = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] per_volume_size_limit = -1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] periodic_fuzzy_delay = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] periodic_interval = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] public_endpoint = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] publish_errors = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] quota_backup_gigabytes = 1000 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] quota_backups = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] quota_gigabytes = 1000 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] quota_groups = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] quota_snapshots = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] quota_volumes = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] rate_limit_burst = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] rate_limit_except_level = CRITICAL {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] rate_limit_interval = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] reinit_driver_count = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] replication_device = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] report_discard_supported = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] report_interval = 120 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] reservation_clean_interval = 86400 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] reservation_expire = 86400 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] reserved_image_namespaces = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] reserved_percentage = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] rpc_response_timeout = 120 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] run_external_periodic_tasks = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] scst_target_driver = iscsi {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] scst_target_iqn_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_down_time = 720 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] shell_completion = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] snapshot_name_template = snapshot-%s {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] split_loggers = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] state_path = /opt/stack/data/cinder {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] storage_availability_zone = nova {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] storage_protocol = iSCSI {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] syslog_log_facility = LOG_USER {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] target_helper = lioadm {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] target_ip_address = 192.168.122.117 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] target_port = 3260 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] target_protocol = iscsi {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] target_secondary_ip_addresses = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] trace_flags = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] transport_url = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] until_refresh = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] use_chap_auth = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] use_default_quota_class = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] use_journal = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] use_json = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] use_multipath_for_image_xfer = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] use_stderr = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] use_syslog = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] verify_glance_signatures = enabled {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_api_class = cinder.volume.api.API {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_backend_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_clear = zero {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_clear_ionice = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_clear_size = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_copy_bps_limit = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_dd_blocksize = 1M {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_name_template = volume-%s {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_service_inithost_offload = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volume_usage_audit_period = month {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] zoning_mode = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_concurrency.disable_process_locking = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.auth_section = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.auth_type = password {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.auth_version = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.cache = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.include_service_catalog = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.insecure = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.interface = public {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_password = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87022) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcache_username = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.region_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.service_type = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: WARNING cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.backend = dogpile.cache.null {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.backend_argument = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.backend_expiration_time = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.config_prefix = cache.oslo {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.debug_cache_backend = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.enable_retry_client = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.enable_socket_keepalive = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.expiration_time = 600 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.hashclient_retry_attempts = 2 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.memcache_dead_retry = 300 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.memcache_pool_maxsize = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.memcache_sasl_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.password = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.proxies = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.redis_db = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.redis_server = localhost:6379 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.retry_attempts = 2 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.retry_delay = 0.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.socket_keepalive_count = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.socket_keepalive_idle = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.socket_keepalive_interval = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.socket_timeout = 1.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.tls_allowed_ciphers = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.tls_cafile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.tls_certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.tls_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.tls_keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cache.username = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] coordination.backend_url = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.asyncio_connection = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.asyncio_slave_connection = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.backend = sqlalchemy {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.connection = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.connection_debug = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.connection_parameters = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.connection_recycle_time = 3600 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.connection_trace = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.db_inc_retry_interval = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.db_max_retries = 20 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.db_max_retry_interval = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.db_retry_interval = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.max_overflow = 50 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.max_pool_size = 5 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.max_retries = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.mysql_wsrep_sync_wait = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.pool_timeout = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.retry_interval = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.slave_connection = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.sqlite_synchronous = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.synchronous_reader = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] database.use_db_reconnect = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_tracing.insecure = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.connection_string = messaging:// {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.es_doc_type = notification {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.es_scroll_size = 10000 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.es_scroll_time = 2m {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.filter_error_trace = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.hmac_keys = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.sentinel_service_name = mymaster {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.socket_timeout = 0.1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.trace_requests = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler.trace_sqlalchemy = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler_jaeger.process_tags = {} {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler_jaeger.service_name_prefix = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] profiler_otlp.service_name_prefix = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.enforce_new_defaults = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.policy_default_rule = default {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.policy_file = policy.yaml {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] privsep_osbrick.group = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] privsep_osbrick.helper_command = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] privsep_osbrick.user = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_sys_admin.group = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_sys_admin.helper_command = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] cinder_sys_admin.user = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.auth_section = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.auth_type = password {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.cafile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.collect_timing = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.insecure = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.send_service_user_token = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.split_loggers = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.timeout = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.tls_ciphers = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] service_user.tls_min_version = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.auth_section = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.auth_type = password {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.collect_timing = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.insecure = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.region_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.split_loggers = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.timeout = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.tls_ciphers = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] glance.tls_min_version = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.backend_availability_zone = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.chap_password = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.chap_username = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.disk_geometry = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.driver_client_cert = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.driver_client_cert_key = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.driver_data_namespace = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.driver_use_ssl = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.extra_capabilities = {} {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.filter_function = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.goodness_function = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.iscsi_target_flags = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.iscsi_write_cache = on {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.iser_helper = tgtadm {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.iser_port = 3260 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_host = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_login = admin {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_mount_options = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_password = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_private_key = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_share_path = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.num_shell_tries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.quobyte_volume_url = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.replication_device = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.report_discard_supported = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.reserved_percentage = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.target_helper = tgtadm {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.target_port = 3260 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.target_protocol = iscsi {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.trace_flags = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.unique_fqdn_network = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.use_chap_auth = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_backend_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_clear = zero {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_clear_ionice = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_clear_size = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_reports.file_event_handler = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_reports.log_dir = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.backend_availability_zone = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.backend_host = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.chap_password = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.chap_username = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.chiscsi_conf = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.disk_geometry = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.driver_client_cert = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.driver_data_namespace = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.driver_use_ssl = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.extra_capabilities = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.filter_function = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.goodness_function = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.iser_helper = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.iser_ip_address = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.iser_port = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.iser_target_prefix = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_host = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_login = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_mount_options = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_password = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_private_key = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_share_path = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_ssh_port = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.num_shell_tries = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.nvmet_port_id = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.replication_device = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.report_discard_supported = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.reserved_percentage = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.scst_target_driver = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.storage_protocol = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.target_helper = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.target_ip_address = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.target_port = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.target_prefix = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.target_protocol = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.trace_flags = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.use_chap_auth = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_clear = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_clear_size = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] QuobyteHD.volumes_dir = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: INFO cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 ... Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a -c /etc/quobyte/client-cinder.cfg {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.ssl = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_notifications.driver = [] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_notifications.retry = -1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] key_manager.fixed_key = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.barbican_api_version = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.barbican_endpoint = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.barbican_endpoint_type = public {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.barbican_region_name = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.cafile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.collect_timing = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.insecure = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.number_of_retries = 60 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.retry_delay = 1 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.send_service_user_token = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.split_loggers = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.timeout = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.tls_ciphers = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.tls_min_version = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.verify_ssl = True {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican.verify_ssl_path = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.auth_section = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.auth_type = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.cafile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.certfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.collect_timing = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.insecure = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.keyfile = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.split_loggers = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.timeout = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.tls_ciphers = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] barbican_service_user.tls_min_version = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.approle_role_id = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.approle_secret_id = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.auth_method = approle {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.auth_path = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.kv_mountpoint = secret {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.kv_path = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.kv_version = 2 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.namespace = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.root_token_id = **** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.ssl_ca_crt_file = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.timeout = 60.0 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.token_file = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.token_role = None {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.use_ssl = False {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:09 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a -c /etc/quobyte/client-cinder.cfg Sep 05 20:47:09 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] ******************************************************************************** {{(pid=86779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 20:47:09 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:09 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.497s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:09 devstack cinder-volume[87022]: INFO cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 succeeded Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.518s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:09 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:09 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:47:09 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:10 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.279s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:10 devstack cinder-volume[87022]: INFO cinder.volume.driver [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.volume.driver [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.656494140625, 'free_capacity_gb': 1773.656494140625, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87022) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_db.sqlalchemy.engines [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG dbcounter [-] [87022] Writer thread running {{(pid=87022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.db.api [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Building query based on filter {{(pid=87022) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.image.image_utils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87022) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 20:47:10 devstack cinder-volume[87022]: INFO cinder.keymgr.migration [None req-0ff98988-d066-44a0-9a7c-1970eeb81aa2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:10 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:47:10 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:10 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.264s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:47:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Driver initialization completed successfully. Sep 05 20:47:10 devstack cinder-volume[87022]: INFO cinder.manager [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Initiating service 3 cleanup Sep 05 20:47:10 devstack cinder-volume[87022]: INFO cinder.manager [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Service 3 cleanup completed. Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.service [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Creating RPC server for service cinder-volume {{(pid=87022) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.service [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87022) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 20:47:10 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:10 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:10 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:47:10 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:11 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:11 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.296s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:11 devstack cinder-volume[87022]: INFO cinder.volume.manager [None req-a9994a40-0a60-484f-b817-c56fe9a0d8b3 None None] Driver post RPC initialization completed successfully. Sep 05 20:47:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-479aed35-160e-4319-b3da-d51537596978 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-479aed35-160e-4319-b3da-d51537596978 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-479aed35-160e-4319-b3da-d51537596978 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:47:15 devstack cinder-volume[87022]: DEBUG cinder.volume.drivers.quobyte [None req-479aed35-160e-4319-b3da-d51537596978 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:47:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-479aed35-160e-4319-b3da-d51537596978 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:15 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-479aed35-160e-4319-b3da-d51537596978 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:15 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:47:15 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:16 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:16 devstack cinder-volume[87022]: DEBUG oslo_concurrency.processutils [None req-479aed35-160e-4319-b3da-d51537596978 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.267s {{(pid=87022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:16 devstack cinder-volume[87022]: DEBUG cinder.manager [None req-479aed35-160e-4319-b3da-d51537596978 None None] Notifying Schedulers of capabilities ... {{(pid=87022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:47:16 devstack cinder-volume[86779]: INFO oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Caught SIGTERM, stopping children Sep 05 20:47:16 devstack cinder-volume[86779]: DEBUG oslo_concurrency.lockutils [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Acquiring lock "singleton_lock" {{(pid=86779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:47:16 devstack cinder-volume[86779]: DEBUG oslo_concurrency.lockutils [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Acquired lock "singleton_lock" {{(pid=86779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:47:16 devstack cinder-volume[86779]: DEBUG oslo_concurrency.lockutils [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Releasing lock "singleton_lock" {{(pid=86779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:47:16 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Stop services. {{(pid=86779) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 05 20:47:16 devstack cinder-volume[86779]: DEBUG oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Killing children. {{(pid=86779) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 05 20:47:16 devstack cinder-volume[86779]: INFO oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Waiting on 1 children to exit Sep 05 20:47:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Acquiring lock "singleton_lock" {{(pid=87022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:47:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Acquired lock "singleton_lock" {{(pid=87022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:47:19 devstack cinder-volume[87022]: DEBUG oslo_concurrency.lockutils [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Releasing lock "singleton_lock" {{(pid=87022) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:47:19 devstack cinder-volume[87022]: WARNING amqp [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:47:19 devstack cinder-volume[87022]: WARNING amqp [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 05 20:47:19 devstack cinder-volume[86779]: INFO oslo_service.backend._eventlet.service [None req-2eb0c777-8147-415c-af0c-acfe3d9f7299 None None] Child 87022 exited with status 0 Sep 05 20:47:19 devstack cinder-volume[87463]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 05 20:47:19 devstack cinder-volume[87463]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:47:19 devstack cinder-volume[87463]: we strongly recommend against using it for new projects. Sep 05 20:47:19 devstack cinder-volume[87463]: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:47:19 devstack cinder-volume[87463]: framework. For more detail see Sep 05 20:47:19 devstack cinder-volume[87463]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:47:19 devstack cinder-volume[87463]: import eventlet # noqa Sep 05 20:47:23 devstack cinder-volume[87463]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 05 20:47:23 devstack cinder-volume[87463]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 05 20:47:23 devstack cinder-volume[87463]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87463) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 05 20:47:24 devstack cinder-volume[87463]: INFO dbcounter [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Registered counter for database cinder Sep 05 20:47:24 devstack cinder-volume[87463]: DEBUG oslo_db.sqlalchemy.engines [None req-000d7933-205f-420f-86dd-b590887d85dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87463) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG dbcounter [-] [87463] Writer thread running {{(pid=87463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:47:25 devstack cinder-volume[87463]: INFO cinder.rpc [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 05 20:47:25 devstack cinder-volume[87463]: INFO cinder.rpc [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_db.sqlalchemy.engines [None req-000d7933-205f-420f-86dd-b590887d85dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87463) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:25 devstack cinder-volume[87463]: INFO cinder.volume.manager [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Determined volume DB was empty at startup. Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG cinder.volume.manager [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87463) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 05 20:47:25 devstack cinder-volume[87463]: WARNING stevedore.named [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 05 20:47:25 devstack cinder-volume[87463]: WARNING castellan.key_manager [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:47:25 devstack cinder-volume[87463]: WARNING cinder.keymgr.conf_key_mgr [None req-000d7933-205f-420f-86dd-b590887d85dd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 05 20:47:25 devstack cinder-volume[87463]: INFO cinder.volume.manager [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_db.sqlalchemy.engines [None req-000d7933-205f-420f-86dd-b590887d85dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87463) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:25 devstack cinder-volume[87463]: INFO oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Starting 1 workers Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Started child 87778 {{(pid=87463) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Full set of CONF: {{(pid=87463) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] ******************************************************************************** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] Configuration options gathered from: {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] ================================================================================ {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] allow_availability_zone_fallback = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] allow_compression_on_image_upload = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] allowed_direct_url_schemes = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] api_rate_limit = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] auth_strategy = keystone {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_availability_zone = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_host = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_stats_polling_interval = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backup_api_class = cinder.backup.api.API {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backup_name_template = backup-%s {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backup_use_same_host = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backup_use_temp_snapshot = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] chap_password = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87778]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] chap_username = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_internal_tenant_project_id = f7f7019426374bddb6308e52884ef70a {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_internal_tenant_user_id = 14822ec627734a509f649621886bca32 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cluster = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] compression_format = gzip {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] compute_api_class = cinder.compute.nova.API {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] config_dir = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] config_source = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] control_exchange = openstack {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] debug = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] default_availability_zone = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] default_group_type = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] default_volume_type = QuobyteHD {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] disk_geometry = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] driver_client_cert = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] driver_client_cert_key = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] driver_data_namespace = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] driver_ssl_cert_path = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] driver_ssl_cert_verify = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] driver_use_ssl = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] enable_new_services = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] enable_unsupported_driver = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] enabled_backends = ['QuobyteHD'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] enforce_multipath_for_image_xfer = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] filter_function = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_api_insecure = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_api_servers = ['http://192.168.122.117/image'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_api_ssl_compression = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_ca_certificates_file = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_catalog_info = image:glance:publicURL {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_num_retries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance_request_timeout = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] goodness_function = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] graceful_shutdown_timeout = 5 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] group_api_class = cinder.group.api.API {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] host = devstack {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_compress_on_upload = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_conversion_address_space_limit = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_conversion_cpu_limit = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_conversion_disable = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_upload_use_cinder_backend = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_upload_use_internal_tenant = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_volume_cache_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_volume_cache_max_count = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] image_volume_cache_max_size_gb = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] init_host_max_objects_retrieval = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] instance_format = [instance: %(uuid)s] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] iscsi_target_flags = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] iscsi_write_cache = on {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] iser_helper = tgtadm {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] iser_ip_address = 192.168.122.117 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] iser_port = 3260 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_color = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_config_append = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_dir = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_file = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_options = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_rotate_interval = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_rotate_interval_type = days {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] log_rotation_type = none {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] max_age = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] max_logfile_count = 30 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] max_logfile_size_mb = 200 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] max_over_subscription_ratio = 20.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] message_reap_interval = 86400 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] message_ttl = 2592000 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] migration_create_volume_timeout_secs = 300 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] monkey_patch = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] monkey_patch_modules = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] my_ip = 192.168.122.117 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] no_snapshot_gb_quota = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] num_iser_scan_tries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] num_shell_tries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] num_volume_device_scan_tries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] nvmeof_conn_info_version = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] nvmet_ns_id = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] nvmet_port_id = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] osapi_max_limit = 1000 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] osapi_volume_ext_list = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] osapi_volume_listen = 0.0.0.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] osapi_volume_listen_port = 8776 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] osapi_volume_use_ssl = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] osapi_volume_workers = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] per_volume_size_limit = -1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] periodic_fuzzy_delay = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] periodic_interval = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] project_id_regex = [0-9a-f\-]+ {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] public_endpoint = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] publish_errors = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] quota_backup_gigabytes = 1000 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] quota_backups = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] quota_gigabytes = 1000 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] quota_groups = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] quota_snapshots = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] quota_volumes = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] rate_limit_burst = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] rate_limit_except_level = CRITICAL {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] rate_limit_interval = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] reinit_driver_count = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] replication_device = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] report_discard_supported = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] report_interval = 120 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] reservation_clean_interval = 86400 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] reservation_expire = 86400 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] reserved_image_namespaces = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] reserved_percentage = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] rpc_response_timeout = 120 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] run_external_periodic_tasks = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] scst_target_driver = iscsi {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] scst_target_iqn_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_down_time = 720 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] shell_completion = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] snapshot_name_template = snapshot-%s {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] split_loggers = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] state_path = /opt/stack/data/cinder {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] storage_availability_zone = nova {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] storage_protocol = iSCSI {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] syslog_log_facility = LOG_USER {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] target_helper = lioadm {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] target_ip_address = 192.168.122.117 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] target_port = 3260 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] target_protocol = iscsi {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] target_secondary_ip_addresses = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] trace_flags = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] transfer_api_class = cinder.transfer.api.API {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] transport_url = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] until_refresh = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] use_chap_auth = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] use_default_quota_class = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] use_journal = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] use_json = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] use_multipath_for_image_xfer = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] use_stderr = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] use_syslog = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] verify_glance_signatures = enabled {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_api_class = cinder.volume.api.API {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_backend_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_clear = zero {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_clear_ionice = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_clear_size = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_copy_bps_limit = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_dd_blocksize = 1M {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_name_template = volume-%s {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_service_inithost_offload = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volume_usage_audit_period = month {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] zoning_mode = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_concurrency.disable_process_locking = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.auth_section = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.auth_type = password {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.auth_version = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.cache = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.delay_auth_decision = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.http_connect_timeout = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.include_service_catalog = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.insecure = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.interface = public {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_password = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Starting volume driver QuobyteDriver (1.2) Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87778) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcache_username = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.region_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.service_token_roles_required = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.service_type = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.token_cache_time = 300 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.117/identity {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.backend = dogpile.cache.null {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.backend_argument = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.backend_expiration_time = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.config_prefix = cache.oslo {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.debug_cache_backend = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.enable_retry_client = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.enable_socket_keepalive = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.expiration_time = 600 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.hashclient_retry_attempts = 2 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.memcache_dead_retry = 300 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.memcache_pool_maxsize = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.memcache_sasl_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.password = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.proxies = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.redis_db = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.redis_sentinel_service_name = mymaster {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.redis_server = localhost:6379 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.retry_attempts = 2 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.retry_delay = 0.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.socket_keepalive_count = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.socket_keepalive_idle = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.socket_keepalive_interval = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.socket_timeout = 1.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.tls_allowed_ciphers = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.tls_cafile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.tls_certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.tls_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.tls_keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cache.username = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] coordination.backend_url = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.asyncio_connection = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.asyncio_slave_connection = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.backend = sqlalchemy {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.connection = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.connection_debug = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.connection_parameters = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.connection_recycle_time = 3600 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.connection_trace = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.db_inc_retry_interval = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.db_max_retries = 20 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.db_max_retry_interval = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.db_retry_interval = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.max_overflow = 50 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.max_pool_size = 5 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.max_retries = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.mysql_wsrep_sync_wait = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.pool_timeout = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.retry_interval = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.slave_connection = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.sqlite_synchronous = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.synchronous_reader = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] database.use_db_reconnect = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_tracing.insecure = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.connection_string = messaging:// {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.es_doc_type = notification {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.es_scroll_size = 10000 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.es_scroll_time = 2m {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.filter_error_trace = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.hmac_keys = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.sentinel_service_name = mymaster {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.socket_timeout = 0.1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.trace_requests = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler.trace_sqlalchemy = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler_jaeger.process_tags = {} {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler_jaeger.service_name_prefix = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] profiler_otlp.service_name_prefix = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.enforce_new_defaults = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.policy_default_rule = default {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.policy_file = policy.yaml {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_policy.remote_timeout = 60.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] privsep_osbrick.group = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] privsep_osbrick.helper_command = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] privsep_osbrick.user = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_sys_admin.group = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_sys_admin.helper_command = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] cinder_sys_admin.user = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.auth_section = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.auth_type = password {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.cafile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.collect_timing = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.insecure = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.send_service_user_token = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.split_loggers = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.timeout = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.tls_ciphers = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] service_user.tls_min_version = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.auth_section = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.auth_type = password {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.collect_timing = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.insecure = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.region_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.split_loggers = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.timeout = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.tls_ciphers = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] glance.tls_min_version = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.backend_availability_zone = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.chap_password = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.chap_username = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.disk_geometry = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.driver_client_cert = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.driver_client_cert_key = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.driver_data_namespace = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.driver_use_ssl = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.enable_unsupported_driver = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.extra_capabilities = {} {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.filter_function = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.goodness_function = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.iscsi_target_flags = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.iscsi_write_cache = on {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.iser_helper = tgtadm {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.iser_ip_address = 192.168.122.117 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.iser_port = 3260 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_host = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_login = admin {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_mount_options = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_password = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_private_key = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_share_path = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_ssh_port = 22 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.num_shell_tries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.nvmet_port_id = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.quobyte_client_cfg = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.quobyte_volume_url = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.replication_device = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.report_discard_supported = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.reserved_percentage = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.scst_target_driver = iscsi {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.scst_target_iqn_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.storage_protocol = iSCSI {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.target_helper = tgtadm {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.target_ip_address = 192.168.122.117 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.target_port = 3260 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.target_protocol = iscsi {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.trace_flags = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.unique_fqdn_network = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.use_chap_auth = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_backend_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_clear = zero {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_clear_ionice = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_clear_size = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_reports.file_event_handler = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_reports.log_dir = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.backend_availability_zone = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.backend_host = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.chap_password = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.chap_username = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.chiscsi_conf = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.disk_geometry = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.driver_client_cert = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.driver_client_cert_key = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.driver_data_namespace = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.driver_use_ssl = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.extra_capabilities = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.filter_function = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.goodness_function = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.iscsi_target_flags = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.iscsi_write_cache = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.iser_helper = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.iser_ip_address = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.iser_port = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.iser_target_prefix = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_host = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_login = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_mount_options = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_password = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_private_key = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_share_path = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_ssh_port = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.num_shell_tries = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nvmet_ns_id = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.nvmet_port_id = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.replication_device = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.report_discard_supported = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.reserved_percentage = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.scst_target_driver = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.storage_protocol = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.target_helper = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.target_ip_address = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.target_port = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.target_prefix = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.target_protocol = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.trace_flags = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.unique_fqdn_network = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.use_chap_auth = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_clear = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_clear_ionice = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_clear_size = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] QuobyteHD.volumes_dir = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.ssl = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.ssl_version = {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_notifications.driver = [] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_notifications.retry = -1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] oslo_messaging_notifications.transport_url = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] key_manager.fixed_key = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.barbican_api_version = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.barbican_endpoint = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.barbican_endpoint_type = public {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.barbican_region_name = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.cafile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.collect_timing = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.insecure = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.number_of_retries = 60 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.retry_delay = 1 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.send_service_user_token = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.split_loggers = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.timeout = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.tls_ciphers = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.tls_min_version = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87778) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 05 20:47:25 devstack quobyte-client[87780]: Reading configuration file: /etc/quobyte/client.cfg Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.verify_ssl = True {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican.verify_ssl_path = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.auth_section = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.auth_type = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.cafile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.certfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.collect_timing = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack quobyte-client[87780]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.insecure = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.keyfile = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.split_loggers = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.timeout = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.tls_ciphers = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] barbican_service_user.tls_min_version = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.approle_role_id = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.approle_secret_id = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.auth_method = approle {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.auth_path = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.kv_mountpoint = secret {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.kv_path = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.kv_version = 2 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.namespace = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.root_token_id = **** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.ssl_ca_crt_file = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.timeout = 60.0 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.token_file = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.token_role = None {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.use_ssl = False {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 05 20:47:25 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 05 20:47:25 devstack cinder-volume[87463]: DEBUG oslo_service.backend._eventlet.service [None req-000d7933-205f-420f-86dd-b590887d85dd None None] ******************************************************************************** {{(pid=87463) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Running cmd (subprocess): mount.quobyte {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:25 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:47:25 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:26 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:26 devstack cinder-volume[87778]: INFO cinder.volume.driver [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Driver hasn't implemented _init_vendor_properties() Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.volume.driver [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.656494140625, 'free_capacity_gb': 1773.656494140625, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87778) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_db.sqlalchemy.engines [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writer thread running {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.db.api [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Building query based on filter {{(pid=87778) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87778) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:26 devstack cinder-volume[87778]: INFO cinder.keymgr.migration [None req-3b0d2521-60b2-40d5-bb60-ebe37da6a967 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 05 20:47:26 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:47:26 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:26 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.241s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:47:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Driver initialization completed successfully. Sep 05 20:47:26 devstack cinder-volume[87778]: INFO cinder.manager [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Initiating service 3 cleanup Sep 05 20:47:26 devstack cinder-volume[87778]: INFO cinder.manager [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Service 3 cleanup completed. Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.service [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Creating RPC server for service cinder-volume {{(pid=87778) start /opt/stack/cinder/cinder/service.py:231}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.service [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87778) start /opt/stack/cinder/cinder/service.py:237}} Sep 05 20:47:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:47:26 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:47:26 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:47:26 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Sep 05 20:47:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.251s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:47:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-616d12a8-6bbf-4585-9f39-aaf011c5c2f0 None None] Driver post RPC initialization completed successfully. Sep 05 20:47:35 devstack cinder-volume[87463]: DEBUG dbcounter [-] [87463] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87463) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:47:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:47:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=3 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:48:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:48:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 6 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:48:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Flow 'volume_create_manager' (641c585d-6101-47f8-8fce-889bc721ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf11216a-01ab-49b5-b580-62e978378afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf11216a-01ab-49b5-b580-62e978378afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1169825072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941fd4f3-2786-4555-9417-5c18abcd5280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4809491705498f932144e9aa43847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:34Z,use_quota=True,user_id='2a4d2670136945ff97dac81bc52294ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7648063-b124-4fa2-acdf-78a43faf3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7648063-b124-4fa2-acdf-78a43faf3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed84f42a-7fb4-4940-9ef5-82570aa89569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed84f42a-7fb4-4940-9ef5-82570aa89569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941fd4f3-2786-4555-9417-5c18abcd5280', 'volume_name': 'volume-941fd4f3-2786-4555-9417-5c18abcd5280', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703c1b1d-aaf2-4fc7-908f-cc58c84fa284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703c1b1d-aaf2-4fc7-908f-cc58c84fa284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b36b67c-477b-4c5e-a0fe-54527c8c7a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Volume 941fd4f3-2786-4555-9417-5c18abcd5280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941fd4f3-2786-4555-9417-5c18abcd5280', 'volume_size': 1} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1169825072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941fd4f3-2786-4555-9417-5c18abcd5280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4809491705498f932144e9aa43847f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:34Z,use_quota=True,user_id='2a4d2670136945ff97dac81bc52294ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Creating volume 941fd4f3-2786-4555-9417-5c18abcd5280 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:48:34 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:48:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:34 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 1073741824 Sep 05 20:48:34 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:35 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 1073741824" returned: 0 in 1.034s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:36 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 Sep 05 20:48:36 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:36 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280" returned: 0 in 0.451s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b36b67c-477b-4c5e-a0fe-54527c8c7a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941fd4f3-2786-4555-9417-5c18abcd5280', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02277400-c1d2-423d-9b3b-df842c36e06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:36 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Volume volume-941fd4f3-2786-4555-9417-5c18abcd5280 (941fd4f3-2786-4555-9417-5c18abcd5280): created successfully Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02277400-c1d2-423d-9b3b-df842c36e06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Flow 'volume_create_manager' (641c585d-6101-47f8-8fce-889bc721ea97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-85614962-5670-4e4d-a796-fe2f947e9e32 tempest-DeleteServersTestJSON-801547544 None] Created volume successfully. Sep 05 20:48:43 devstack cinder-volume[87778]: WARNING py.warnings [req-69156f70-0cf8-43a7-8aa4-bf60efe1bbdd req-b00da586-3155-4337-86c9-c4760c90ca0c tempest-DeleteServersTestJSON-801547544 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 05 20:48:43 devstack cinder-volume[87778]: .first() Sep 05 20:48:43 devstack cinder-volume[87778]: Sep 05 20:48:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-69156f70-0cf8-43a7-8aa4-bf60efe1bbdd req-b00da586-3155-4337-86c9-c4760c90ca0c tempest-DeleteServersTestJSON-801547544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-69156f70-0cf8-43a7-8aa4-bf60efe1bbdd req-b00da586-3155-4337-86c9-c4760c90ca0c tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-69156f70-0cf8-43a7-8aa4-bf60efe1bbdd req-b00da586-3155-4337-86c9-c4760c90ca0c tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-69156f70-0cf8-43a7-8aa4-bf60efe1bbdd req-b00da586-3155-4337-86c9-c4760c90ca0c tempest-DeleteServersTestJSON-801547544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-941fd4f3-2786-4555-9417-5c18abcd5280', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b1e3001-f1cf-4822-8c48-60323c3d8f21', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:48:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-69156f70-0cf8-43a7-8aa4-bf60efe1bbdd req-b00da586-3155-4337-86c9-c4760c90ca0c tempest-DeleteServersTestJSON-801547544 None] attachment_update completed successfully. Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Flow 'volume_create_manager' (f02a343b-0e2b-44b6-bc60-32d5c837485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fe9e5b-5233-4f07-9515-7f4eedf10853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fe9e5b-5233-4f07-9515-7f4eedf10853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1258231613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c7376f-34d6-4984-8cb5-1ecf12abf4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4fbf93c604beb9bdc3c30115d2842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:45Z,use_quota=True,user_id='e7de4f88510d46a1899226e4f8fd230a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d5544a-ffb1-4da8-96de-0cd2b7c634a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d5544a-ffb1-4da8-96de-0cd2b7c634a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293d80de-89c4-4bc1-9f50-14d032a881c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293d80de-89c4-4bc1-9f50-14d032a881c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c7376f-34d6-4984-8cb5-1ecf12abf4ca', 'volume_name': 'volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d6aaa8-784a-4a70-bbf5-e5f541deeae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d6aaa8-784a-4a70-bbf5-e5f541deeae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d2fb64-14c8-49a5-bd6e-84ce530ae1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:45 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Volume 25c7376f-34d6-4984-8cb5-1ecf12abf4ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca', 'volume_size': 1} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1258231613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c7376f-34d6-4984-8cb5-1ecf12abf4ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b4fbf93c604beb9bdc3c30115d2842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:45Z,use_quota=True,user_id='e7de4f88510d46a1899226e4f8fd230a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Creating volume 25c7376f-34d6-4984-8cb5-1ecf12abf4ca {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:48:45 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:48:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:45 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca 1073741824 Sep 05 20:48:45 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:46 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca 1073741824" returned: 0 in 0.939s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:46 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca Sep 05 20:48:46 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:47 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca" returned: 0 in 0.641s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:48:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d2fb64-14c8-49a5-bd6e-84ce530ae1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1063092b-cfa1-4046-8e33-eb7637ccae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Volume volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca (25c7376f-34d6-4984-8cb5-1ecf12abf4ca): created successfully Sep 05 20:48:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1063092b-cfa1-4046-8e33-eb7637ccae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Flow 'volume_create_manager' (f02a343b-0e2b-44b6-bc60-32d5c837485e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f3f3a634-109c-4348-a30d-9143251a28f1 tempest-VolumesAdminNegativeTest-1852011197 None] Created volume successfully. Sep 05 20:48:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Acquiring lock "cinder-25c7376f-34d6-4984-8cb5-1ecf12abf4ca-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Lock "cinder-25c7376f-34d6-4984-8cb5-1ecf12abf4ca-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Acquiring lock "cinder-quobyte-25c7376f-34d6-4984-8cb5-1ecf12abf4ca" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Lock "cinder-quobyte-25c7376f-34d6-4984-8cb5-1ecf12abf4ca" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:49 devstack cinder-volume[87778]: INFO oslo.privsep.daemon [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbccaumoi/privsep.sock'] Sep 05 20:48:49 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbccaumoi/privsep.sock Sep 05 20:48:49 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Flow 'volume_create_manager' (dc5ebd1c-d612-4d7b-9a81-3d9b6526cca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708940ce-f923-43fd-a3f1-42b48d013d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708940ce-f923-43fd-a3f1-42b48d013d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-57124369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80860b8d-c2e6-48ec-be6c-5936cf1c13e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de24768b17544d468df397de46ca4572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:50Z,use_quota=True,user_id='4dfaedb00ffa4a9f88b9aa16da049267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(333a5637-ae7e-4ffd-bea4-efaa40ae0c29),volume_type_id=333a5637-ae7e-4ffd-bea4-efaa40ae0c29)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9aa19a-208a-42f5-84da-03d15d95c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9aa19a-208a-42f5-84da-03d15d95c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4723e4e2-fd98-4357-a4a8-611747283018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4723e4e2-fd98-4357-a4a8-611747283018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80860b8d-c2e6-48ec-be6c-5936cf1c13e9', 'volume_name': 'volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9adeb1b-518a-41c6-bb43-410f22bad0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9adeb1b-518a-41c6-bb43-410f22bad0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1fd125-790b-445f-902c-ee7bebcc8a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:50 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Volume 80860b8d-c2e6-48ec-be6c-5936cf1c13e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9', 'volume_size': 1} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-57124369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80860b8d-c2e6-48ec-be6c-5936cf1c13e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de24768b17544d468df397de46ca4572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:48:50Z,use_quota=True,user_id='4dfaedb00ffa4a9f88b9aa16da049267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(333a5637-ae7e-4ffd-bea4-efaa40ae0c29),volume_type_id=333a5637-ae7e-4ffd-bea4-efaa40ae0c29)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Creating volume 80860b8d-c2e6-48ec-be6c-5936cf1c13e9 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:48:50 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:50 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 1073741824 Sep 05 20:48:50 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-62773b46-7edf-40fb-977d-05ab3751dd21 req-849fb807-b236-4b97-a70b-48e42e96cb5d tempest-DeleteServersTestJSON-801547544 None] Terminate volume connection completed successfully. Sep 05 20:48:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-62773b46-7edf-40fb-977d-05ab3751dd21 req-849fb807-b236-4b97-a70b-48e42e96cb5d tempest-DeleteServersTestJSON-801547544 None] Deleting attachment 8b1e3001-f1cf-4822-8c48-60323c3d8f21. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: Sep 05 20:48:51 devstack cinder-volume[87778]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 05 20:48:51 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 1073741824" returned: 0 in 0.948s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:51 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 Sep 05 20:48:51 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:51 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:51 devstack cinder-volume[87778]: INFO oslo.privsep.daemon [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Spawned new privsep daemon via rootwrap Sep 05 20:48:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Accepted privsep connection to /tmp/tmpbccaumoi/privsep.sock {{(pid=87778) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 05 20:48:51 devstack cinder-volume[87778]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 05 20:48:51 devstack cinder-volume[87778]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 05 20:48:51 devstack cinder-volume[87778]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 05 20:48:51 devstack cinder-volume[87778]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89112 Sep 05 20:48:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d367f3cd-257f-4e97-ada1-f67f7cfc025a]: (2,) {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[89668402-a479-4217-83a4-3105bbcb6de3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:52 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca Sep 05 20:48:52 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:52 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9" returned: 0 in 0.571s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1fd125-790b-445f-902c-ee7bebcc8a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488a4b0a-80bf-45fb-861e-3bbcb54f1de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:48:52 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Volume volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 (80860b8d-c2e6-48ec-be6c-5936cf1c13e9): created successfully Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488a4b0a-80bf-45fb-861e-3bbcb54f1de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Flow 'volume_create_manager' (dc5ebd1c-d612-4d7b-9a81-3d9b6526cca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:48:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-78a91322-aaac-4fe0-931b-4dc15f42c60b tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Created volume successfully. Sep 05 20:48:52 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca" returned: 0 in 0.548s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:52 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca Sep 05 20:48:52 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:52 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-25c7376f-34d6-4984-8cb5-1ecf12abf4ca" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Lock "cinder-quobyte-25c7376f-34d6-4984-8cb5-1ecf12abf4ca" released by "delete_volume" :: held 3.197s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:52 devstack cinder-volume[87778]: WARNING cinder.quota [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:48:52 devstack cinder-volume[87778]: WARNING cinder.quota [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:48:52 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Created reservations ['5a7767b6-0bd0-4769-9ce0-ec330f0dfa04', '43a559c4-85c4-4e57-9a91-de8037ba80b8', '32c02af6-017c-4a7e-a667-07ffb121c46d', '541e4c48-2ccd-4999-9695-7c5170aacd68'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:53 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:48:53 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:53 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.339s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:48:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Deleted volume successfully. Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-08be6651-1261-4760-b1e6-aade942f2eba tempest-VolumesAdminNegativeTest-1852011197 None] Lock "cinder-25c7376f-34d6-4984-8cb5-1ecf12abf4ca-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Acquiring lock "cinder-941fd4f3-2786-4555-9417-5c18abcd5280-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Lock "cinder-941fd4f3-2786-4555-9417-5c18abcd5280-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Acquiring lock "cinder-quobyte-941fd4f3-2786-4555-9417-5c18abcd5280" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Lock "cinder-quobyte-941fd4f3-2786-4555-9417-5c18abcd5280" acquired by "delete_volume" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b87c4-bff6-45cf-8828-fbfc42b865af]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:48:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:54 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 Sep 05 20:48:54 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:54 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:48:54 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:54 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280" returned: 0 in 0.738s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:54 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280 Sep 05 20:48:54 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:54 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.435s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:54 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:48:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c92441dd-598f-49f9-a2db-91bdf3cb9b07 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Retype volume completed successfully. Sep 05 20:48:55 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-941fd4f3-2786-4555-9417-5c18abcd5280" returned: 0 in 0.417s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Lock "cinder-quobyte-941fd4f3-2786-4555-9417-5c18abcd5280" released by "delete_volume" :: held 1.219s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Created reservations ['af9a604f-f422-425b-803b-cc65b391adeb', '827d6ab1-7e87-4f00-b8ce-7521a910e61b', '7ee7dd10-77c1-4d2e-a265-2230388067a5', 'a3bdff2c-9eef-4bee-8916-9112455e6a42'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:55 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:48:55 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:55 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.406s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:48:55 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Deleted volume successfully. Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1165c2a5-c725-46dd-9b81-103dd71c8bd6 tempest-DeleteServersTestJSON-801547544 None] Lock "cinder-941fd4f3-2786-4555-9417-5c18abcd5280-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Acquiring lock "cinder-80860b8d-c2e6-48ec-be6c-5936cf1c13e9-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "cinder-80860b8d-c2e6-48ec-be6c-5936cf1c13e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Acquiring lock "cinder-quobyte-80860b8d-c2e6-48ec-be6c-5936cf1c13e9" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "cinder-quobyte-80860b8d-c2e6-48ec-be6c-5936cf1c13e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d88377-071e-4c2b-8377-b7fc6ad88625]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:48:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:56 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 Sep 05 20:48:56 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:56 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9" returned: 0 in 0.490s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:56 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9 Sep 05 20:48:56 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:56 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-80860b8d-c2e6-48ec-be6c-5936cf1c13e9" returned: 0 in 0.406s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "cinder-quobyte-80860b8d-c2e6-48ec-be6c-5936cf1c13e9" released by "delete_volume" :: held 0.955s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:48:56 devstack cinder-volume[87778]: WARNING cinder.quota [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:48:56 devstack cinder-volume[87778]: WARNING cinder.quota [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Created reservations ['cfaa24cc-7931-458f-a650-8879a4dfad36', 'd477d191-d899-4aca-97d1-201ca55eaa75', '14f618d9-9714-4dca-b962-66da19ca802c', 'ab4fd294-c328-4080-b0e8-c1820cad94d7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:48:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:48:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:48:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:48:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:48:57 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:48:57 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:48:57 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Sep 05 20:48:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:48:57 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:48:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Deleted volume successfully. Sep 05 20:48:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-55364c02-d765-4265-b88f-0832254833f7 tempest-VolumeRetypeWithoutMigrationTest-259206656 None] Lock "cinder-80860b8d-c2e6-48ec-be6c-5936cf1c13e9-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:49:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:49:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:49:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:49:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:04 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:49:04 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:05 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.326s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:49:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:49:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 8 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:49:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:49:06 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=44,cinder:INSERT=6,cinder:UPDATE=41,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:07 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=37,cinder:SELECT=27,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Flow 'volume_create_manager' (7275abbe-e990-4680-adee-889eb71eb6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67459e70-2ac6-4675-bdbf-6c9407224720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67459e70-2ac6-4675-bdbf-6c9407224720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2107479616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7932ff-99f4-4f1c-9232-f08ae87c45d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f708fa920945c381466bdbd8ba17b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:20Z,use_quota=True,user_id='a944bdfe96eb4f67a3aaa46bcb540823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c964f8fc-15e4-4f79-abb4-374ee9edefe6),volume_type_id=c964f8fc-15e4-4f79-abb4-374ee9edefe6)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1892b8-42e3-493d-a4b2-c3d505abc830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1892b8-42e3-493d-a4b2-c3d505abc830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af40bd-84a9-421a-a77a-290af8e8413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5af40bd-84a9-421a-a77a-290af8e8413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a7932ff-99f4-4f1c-9232-f08ae87c45d7', 'volume_name': 'volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fbdb56-98bc-4b28-a42c-715d1892d6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fbdb56-98bc-4b28-a42c-715d1892d6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8a637b-8a07-42ac-85e8-404ecb3ace03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:19 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Volume 9a7932ff-99f4-4f1c-9232-f08ae87c45d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7', 'volume_size': 1} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2107479616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a7932ff-99f4-4f1c-9232-f08ae87c45d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f708fa920945c381466bdbd8ba17b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:20Z,use_quota=True,user_id='a944bdfe96eb4f67a3aaa46bcb540823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c964f8fc-15e4-4f79-abb4-374ee9edefe6),volume_type_id=c964f8fc-15e4-4f79-abb4-374ee9edefe6)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Creating volume 9a7932ff-99f4-4f1c-9232-f08ae87c45d7 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:49:19 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:49:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:19 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 1073741824 Sep 05 20:49:19 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:20 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 1073741824" returned: 0 in 0.624s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:20 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 Sep 05 20:49:20 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:20 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8a637b-8a07-42ac-85e8-404ecb3ace03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e902300-7cbd-4b64-ad24-5ac153cf9349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Volume volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 (9a7932ff-99f4-4f1c-9232-f08ae87c45d7): created successfully Sep 05 20:49:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e902300-7cbd-4b64-ad24-5ac153cf9349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Flow 'volume_create_manager' (7275abbe-e990-4680-adee-889eb71eb6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-254d8d68-1a84-403d-bf78-921f1f701cf2 tempest-VolumeTypesAccessTest-388713304 None] Created volume successfully. Sep 05 20:49:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Acquiring lock "cinder-9a7932ff-99f4-4f1c-9232-f08ae87c45d7-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:49:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Lock "cinder-9a7932ff-99f4-4f1c-9232-f08ae87c45d7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Acquiring lock "cinder-quobyte-9a7932ff-99f4-4f1c-9232-f08ae87c45d7" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Lock "cinder-quobyte-9a7932ff-99f4-4f1c-9232-f08ae87c45d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aea3501-e530-47cb-abb8-7fb4029f7b29]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:22 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 Sep 05 20:49:22 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:22 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7" returned: 0 in 0.456s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:22 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7 Sep 05 20:49:22 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:22 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a7932ff-99f4-4f1c-9232-f08ae87c45d7" returned: 0 in 0.308s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Lock "cinder-quobyte-9a7932ff-99f4-4f1c-9232-f08ae87c45d7" released by "delete_volume" :: held 0.810s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:49:22 devstack cinder-volume[87778]: WARNING cinder.quota [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1282908452 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1282908452, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:49:22 devstack cinder-volume[87778]: WARNING cinder.quota [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1282908452 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1282908452, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:49:22 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Created reservations ['4f16e18f-4dd5-4111-a783-c3dd58a85af9', '4152d481-2a67-49c2-a653-806aaa431b7f', 'd05d8d5a-14e8-4579-871b-ebd703d0866c', '46ea62b2-3e42-42bb-8aa3-2e021f19ae95'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:23 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:49:23 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:23 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:49:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Deleted volume successfully. Sep 05 20:49:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7494245c-5c8e-4551-8ed7-6ce1d3bf5ae2 tempest-VolumeTypesAccessTest-388713304 None] Lock "cinder-9a7932ff-99f4-4f1c-9232-f08ae87c45d7-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:49:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Flow 'volume_create_manager' (9d7857a7-3cbb-4065-bb04-6083fe396fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dea1190-1cd8-47c4-8153-9f9091093069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dea1190-1cd8-47c4-8153-9f9091093069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-753450469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc13cc21-7b4d-456e-b30e-df369f77930b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea45d6b06c84a51b0385573d8044641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:46Z,use_quota=True,user_id='bea8e2b48a124db6ade400872bcbea36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223f0a27-6637-4822-82d1-754df7404022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223f0a27-6637-4822-82d1-754df7404022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29378ac-8846-4bc7-9d36-7e9eb918a7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29378ac-8846-4bc7-9d36-7e9eb918a7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc13cc21-7b4d-456e-b30e-df369f77930b', 'volume_name': 'volume-dc13cc21-7b4d-456e-b30e-df369f77930b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1bbf86-6d72-4f32-82c3-f311923512bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1bbf86-6d72-4f32-82c3-f311923512bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85efffaf-e8b5-40bf-9fdb-2d3a1c691943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Volume dc13cc21-7b4d-456e-b30e-df369f77930b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc13cc21-7b4d-456e-b30e-df369f77930b', 'volume_size': 1} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-753450469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc13cc21-7b4d-456e-b30e-df369f77930b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea45d6b06c84a51b0385573d8044641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:46Z,use_quota=True,user_id='bea8e2b48a124db6ade400872bcbea36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Creating volume dc13cc21-7b4d-456e-b30e-df369f77930b {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:49:46 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:49:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:46 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b 1073741824 Sep 05 20:49:46 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:46 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b 1073741824" returned: 0 in 0.648s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:47 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b Sep 05 20:49:47 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:47 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b" returned: 0 in 0.411s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85efffaf-e8b5-40bf-9fdb-2d3a1c691943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc13cc21-7b4d-456e-b30e-df369f77930b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ff8bbe-722d-4a55-a488-6b9bd585ad24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Volume volume-dc13cc21-7b4d-456e-b30e-df369f77930b (dc13cc21-7b4d-456e-b30e-df369f77930b): created successfully Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ff8bbe-722d-4a55-a488-6b9bd585ad24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Flow 'volume_create_manager' (9d7857a7-3cbb-4065-bb04-6083fe396fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e91679db-9354-4ea1-a498-1b23f3cdd3cd tempest-TaggedAttachmentsTest-850058772 None] Created volume successfully. Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Flow 'volume_create_manager' (3d278c68-9300-4a7c-ad01-99588f2a0fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35702856-287b-4b2e-bdd3-4b6a66e143ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35702856-287b-4b2e-bdd3-4b6a66e143ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1698165664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99be083-87d6-44bd-806d-60e78d8f3e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290fdc7db0e34847aab0226980e4151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:55Z,use_quota=True,user_id='964aae468f3f42a28cecc684fbe41f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85069fd9-b4e5-4930-9ac7-5d55b758f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85069fd9-b4e5-4930-9ac7-5d55b758f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e07010-61f7-4357-9230-2611e9df8cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e07010-61f7-4357-9230-2611e9df8cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99be083-87d6-44bd-806d-60e78d8f3e3b', 'volume_name': 'volume-c99be083-87d6-44bd-806d-60e78d8f3e3b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87da89d-16af-499a-abdc-ac11212f4a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87da89d-16af-499a-abdc-ac11212f4a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7af08de-c728-46c9-885b-acefd15e0863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:55 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Volume c99be083-87d6-44bd-806d-60e78d8f3e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99be083-87d6-44bd-806d-60e78d8f3e3b', 'volume_size': 1} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1698165664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99be083-87d6-44bd-806d-60e78d8f3e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290fdc7db0e34847aab0226980e4151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:49:55Z,use_quota=True,user_id='964aae468f3f42a28cecc684fbe41f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Creating volume c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:49:55 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:49:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:55 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b 1073741824 Sep 05 20:49:55 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:56 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b 1073741824" returned: 0 in 1.137s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:56 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b Sep 05 20:49:56 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:57 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b" returned: 0 in 0.550s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7af08de-c728-46c9-885b-acefd15e0863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99be083-87d6-44bd-806d-60e78d8f3e3b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba201b5f-c0b9-4631-9b9d-c69470002700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:49:57 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Volume volume-c99be083-87d6-44bd-806d-60e78d8f3e3b (c99be083-87d6-44bd-806d-60e78d8f3e3b): created successfully Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba201b5f-c0b9-4631-9b9d-c69470002700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Flow 'volume_create_manager' (3d278c68-9300-4a7c-ad01-99588f2a0fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:49:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b7df927d-6997-486c-b4d6-328da6fa8040 tempest-VolumesDeleteCascade-2061476054 None] Created volume successfully. Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:49:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Creating offline snapshot bf7da172-0a07-48be-8655-705eb8be8449 of volume c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:49:58 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d597a2c-3f69-496a-8a06-7d6ca3229b22]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:49:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:58 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b Sep 05 20:49:58 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:58 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b" returned: 0 in 0.875s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:58 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 1G Sep 05 20:49:58 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:49:59 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Sep 05 20:49:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 1G" returned: 0 in 0.665s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:49:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:49:59 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 Sep 05 20:49:59 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:00 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449" returned: 0 in 0.549s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:00 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 is being set with open permissions: ugo+rw Sep 05 20:50:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:00 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 Sep 05 20:50:00 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:00 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:00 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.info Sep 05 20:50:00 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:01 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.info" returned: 0 in 0.553s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:01 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.info is being set with open permissions: ugo+rw Sep 05 20:50:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:01 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.info Sep 05 20:50:01 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:01 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.info" returned: 0 in 0.915s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.096s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f770e089-a617-4559-9fac-08a3790ad299 tempest-VolumesDeleteCascade-2061476054 None] Create snapshot completed successfully Sep 05 20:50:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Creating offline snapshot c1ae8f50-b803-4c88-b6d6-76b3286ddf89 of volume c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:50:03 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed97f0e5-db64-4de1-96fc-4e504b99817c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:03 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 Sep 05 20:50:03 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:03 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449" returned: 0 in 0.719s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99be083-87d6-44bd-806d-60e78d8f3e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:03 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 1G Sep 05 20:50:03 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:04 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 1G" returned: 0 in 1.089s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:04 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 Sep 05 20:50:04 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:04 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:50:04 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:05 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89" returned: 0 in 0.489s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:05 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 is being set with open permissions: ugo+rw Sep 05 20:50:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:05 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 Sep 05 20:50:05 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:05 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.546s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89" returned: 0 in 0.560s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:05 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.097s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f8daf352-8d4d-4bec-bc65-8ae7c876b111 tempest-VolumesDeleteCascade-2061476054 None] Create snapshot completed successfully Sep 05 20:50:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-c99be083-87d6-44bd-806d-60e78d8f3e3b-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-c99be083-87d6-44bd-806d-60e78d8f3e3b-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Performing cascade delete. {{(pid=87778) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 20:50:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-bf7da172-0a07-48be-8655-705eb8be8449-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-bf7da172-0a07-48be-8655-705eb8be8449-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-bf7da172-0a07-48be-8655-705eb8be8449" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-bf7da172-0a07-48be-8655-705eb8be8449" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Deleting offline snapshot bf7da172-0a07-48be-8655-705eb8be8449 of volume c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:50:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] snapshot_file for this snap is: volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:50:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6702d38b-1dc6-4673-819a-88f069fe4614]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:07 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 Sep 05 20:50:07 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:08 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449" returned: 0 in 0.969s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99be083-87d6-44bd-806d-60e78d8f3e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:08 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd00100-411e-4585-92b2-b59afa963c60]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:08 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b Sep 05 20:50:08 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:08 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b" returned: 0 in 0.707s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f0850e-fac8-49fd-b4ae-6bc85b1a09c9]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:09 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 Sep 05 20:50:09 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:09 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89" returned: 0 in 0.484s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99be083-87d6-44bd-806d-60e78d8f3e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed47a4b5-07d1-4ac2-91ae-4bb830f39ab1]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:09 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 Sep 05 20:50:09 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:10 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449" returned: 0 in 0.680s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99be083-87d6-44bd-806d-60e78d8f3e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab5d5d-e99f-4140-9abc-bdb0a7537dc8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:10 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b Sep 05 20:50:10 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:10 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b" returned: 0 in 0.605s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:10 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 Sep 05 20:50:10 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:11 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449" returned: 0 in 0.355s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:11 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449 Sep 05 20:50:11 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:11 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.bf7da172-0a07-48be-8655-705eb8be8449" returned: 0 in 0.271s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 -F qcow2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:11 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 -F qcow2 Sep 05 20:50:11 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:11 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c99be083-87d6-44bd-806d-60e78d8f3e3b /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 -F qcow2" returned: 0 in 0.366s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-bf7da172-0a07-48be-8655-705eb8be8449" released by "_delete_snapshot" :: held 4.844s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" released by "delete_snapshot" :: held 4.882s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:11 devstack cinder-volume[87778]: WARNING cinder.quota [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Created reservations ['ef03badc-f0d8-420f-a0cf-dd2c8df50dee', 'c41970c7-a898-4ca7-bf9c-0906bb482606', '4c185a8a-3810-48f9-8bd9-67937a00ada0', '168a4c75-4c5d-4edd-94e9-854df71636d7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:12 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Delete snapshot completed successfully. Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-bf7da172-0a07-48be-8655-705eb8be8449-delete_snapshot" released by "delete_snapshot" :: held 5.327s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-c1ae8f50-b803-4c88-b6d6-76b3286ddf89-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-c1ae8f50-b803-4c88-b6d6-76b3286ddf89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-c1ae8f50-b803-4c88-b6d6-76b3286ddf89" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c1ae8f50-b803-4c88-b6d6-76b3286ddf89" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Deleting offline snapshot c1ae8f50-b803-4c88-b6d6-76b3286ddf89 of volume c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] snapshot_file for this snap is: volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[770c686a-0306-46b7-b20f-24cc8745b27c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:12 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 Sep 05 20:50:12 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:13 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89" returned: 0 in 0.528s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c99be083-87d6-44bd-806d-60e78d8f3e3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:13 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb539895-f336-4303-8b55-a8882efed47e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:13 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b Sep 05 20:50:13 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:13 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b" returned: 0 in 0.478s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:13 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 Sep 05 20:50:13 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:14 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89" returned: 0 in 0.683s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:14 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89 Sep 05 20:50:14 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:14 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b.c1ae8f50-b803-4c88-b6d6-76b3286ddf89" returned: 0 in 0.356s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c1ae8f50-b803-4c88-b6d6-76b3286ddf89" released by "_delete_snapshot" :: held 2.213s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" released by "delete_snapshot" :: held 2.275s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Created reservations ['275c2f09-8fdd-432b-835d-33c5cd343dec', '0b639c36-47ba-4a66-8959-d0c994b851b6', '8fa06772-ecec-4010-9cd0-1267cf73faa6', '5df4f225-55b3-43e0-af50-7f8b23724e53'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Delete snapshot completed successfully. Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-c1ae8f50-b803-4c88-b6d6-76b3286ddf89-delete_snapshot" released by "delete_snapshot" :: held 2.653s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Snapshots deleted, issuing volume delete {{(pid=87778) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" acquired by "delete_volume" :: waited 0.036s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:15 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d15b50-b09d-4bfd-9435-5e5dcbb76b9e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:15 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b Sep 05 20:50:15 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:15 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b" returned: 0 in 0.703s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:15 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b Sep 05 20:50:15 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:16 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c99be083-87d6-44bd-806d-60e78d8f3e3b" returned: 0 in 0.302s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-c99be083-87d6-44bd-806d-60e78d8f3e3b" released by "delete_volume" :: held 1.077s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Created reservations ['aea9c2b6-026d-4119-a1d5-a262bf677942', '6f283824-aab1-4751-92b9-7545b40694c9', '4ae68833-5e9d-49ea-814e-21d066c51b65', '20c28d06-cba5-4547-93dc-bdbff0dc8601'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:16 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:50:16 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:16 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.276s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Deleted volume successfully. Sep 05 20:50:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f8c29a8f-ad4d-4c2a-adaf-960b27ca17e0 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-c99be083-87d6-44bd-806d-60e78d8f3e3b-delete_volume" released by "delete_volume" :: held 9.858s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:17 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Flow 'volume_create_manager' (9779e346-1027-440f-b76a-f4d632548a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb8c688-704d-4b8c-a6cd-7dff8a02c968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb8c688-704d-4b8c-a6cd-7dff8a02c968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1661997298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5c4258-3563-402e-9324-be7e53aa3ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290fdc7db0e34847aab0226980e4151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:18Z,use_quota=True,user_id='964aae468f3f42a28cecc684fbe41f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f20571-e72e-4004-8776-51c6272e4d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f20571-e72e-4004-8776-51c6272e4d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36630c5e-54d6-42f5-a447-ce1040abd1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36630c5e-54d6-42f5-a447-ce1040abd1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5c4258-3563-402e-9324-be7e53aa3ccf', 'volume_name': 'volume-ab5c4258-3563-402e-9324-be7e53aa3ccf', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad326c81-6e09-4f56-b765-f9b94850ce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad326c81-6e09-4f56-b765-f9b94850ce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8ca00d-670d-4921-a8e4-d7789c11cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Volume ab5c4258-3563-402e-9324-be7e53aa3ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5c4258-3563-402e-9324-be7e53aa3ccf', 'volume_size': 1} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1661997298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5c4258-3563-402e-9324-be7e53aa3ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290fdc7db0e34847aab0226980e4151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:18Z,use_quota=True,user_id='964aae468f3f42a28cecc684fbe41f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Creating volume ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:50:18 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:18 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf 1073741824 Sep 05 20:50:18 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:18 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf 1073741824" returned: 0 in 0.429s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:18 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf Sep 05 20:50:18 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:18 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8ca00d-670d-4921-a8e4-d7789c11cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5c4258-3563-402e-9324-be7e53aa3ccf', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6812be51-af09-4b1c-8610-79ea96a0400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Volume volume-ab5c4258-3563-402e-9324-be7e53aa3ccf (ab5c4258-3563-402e-9324-be7e53aa3ccf): created successfully Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6812be51-af09-4b1c-8610-79ea96a0400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Flow 'volume_create_manager' (9779e346-1027-440f-b76a-f4d632548a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d9f10248-6d01-4015-adc7-d08495b01140 tempest-VolumesDeleteCascade-2061476054 None] Created volume successfully. Sep 05 20:50:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Creating offline snapshot 53164bce-e138-445a-bda3-e9b9b7bbc722 of volume ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:50:19 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6f8d8-175c-4e20-a64c-a316cadcbcaa]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:19 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf Sep 05 20:50:19 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:19 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf" returned: 0 in 0.535s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:19 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 1G Sep 05 20:50:19 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Flow 'volume_create_manager' (041c85fc-1928-4ff3-a442-6e1cc354f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db896a5c-6e50-4302-8903-7f130d00ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db896a5c-6e50-4302-8903-7f130d00ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-640580809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa014a7e-093b-4757-b3b1-ffec55f6d8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db8b0f846c44c9ca67853cfd72b2ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:20Z,use_quota=True,user_id='08cbf73f6c10483cb07dff6bc2b61ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d7f3de-5600-413b-8c42-897aacde5e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d7f3de-5600-413b-8c42-897aacde5e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad60dae4-a615-4706-8e2a-f4a4019d223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad60dae4-a615-4706-8e2a-f4a4019d223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa014a7e-093b-4757-b3b1-ffec55f6d8e4', 'volume_name': 'volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ee7854-ee2f-4474-82f9-b3c82d357c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ee7854-ee2f-4474-82f9-b3c82d357c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7247d4-8b01-45bc-abb3-d408f2f77c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Volume fa014a7e-093b-4757-b3b1-ffec55f6d8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4', 'volume_size': 1} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:20 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 1G" returned: 0 in 0.556s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5c4258-3563-402e-9324-be7e53aa3ccf -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:20 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5c4258-3563-402e-9324-be7e53aa3ccf -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 Sep 05 20:50:20 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:20 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5c4258-3563-402e-9324-be7e53aa3ccf -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722" returned: 0 in 0.284s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:20 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 is being set with open permissions: ugo+rw Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:20 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 Sep 05 20:50:20 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:20 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722" returned: 0 in 0.229s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:20 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.info Sep 05 20:50:20 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:21 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.info" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:21 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.info is being set with open permissions: ugo+rw Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:21 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.info Sep 05 20:50:21 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:21 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.info" returned: 0 in 0.254s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-640580809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa014a7e-093b-4757-b3b1-ffec55f6d8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2db8b0f846c44c9ca67853cfd72b2ac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:20Z,use_quota=True,user_id='08cbf73f6c10483cb07dff6bc2b61ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Creating volume fa014a7e-093b-4757-b3b1-ffec55f6d8e4 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:50:21 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:21 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 1073741824 Sep 05 20:50:21 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-af807026-77d1-4c5f-adf6-593dd1360e6f tempest-VolumesDeleteCascade-2061476054 None] Create snapshot completed successfully Sep 05 20:50:21 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 1073741824" returned: 0 in 0.449s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:21 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 Sep 05 20:50:21 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:22 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4" returned: 0 in 0.265s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7247d4-8b01-45bc-abb3-d408f2f77c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e755f129-8567-4f62-93f5-ebe538d7bedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:22 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Volume volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 (fa014a7e-093b-4757-b3b1-ffec55f6d8e4): created successfully Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e755f129-8567-4f62-93f5-ebe538d7bedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Flow 'volume_create_manager' (041c85fc-1928-4ff3-a442-6e1cc354f565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9e2c2701-0641-4fc2-bdaa-7d15eac6b9a3 tempest-AttachVolumeShelveTestJSON-1563099460 None] Created volume successfully. Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Flow 'volume_create_manager' (e664fe13-fd65-49bc-8624-9a5e64f4f789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10d7d48-916c-496e-9166-90e43441ad06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10d7d48-916c-496e-9166-90e43441ad06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-948604032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9640bd-7bbc-4f4d-8901-00e22675fdb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='290fdc7db0e34847aab0226980e4151d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53164bce-e138-445a-bda3-e9b9b7bbc722,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:23Z,use_quota=True,user_id='964aae468f3f42a28cecc684fbe41f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7288858-0d53-45c1-8794-7de8d3129665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7288858-0d53-45c1-8794-7de8d3129665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84717fb5-c84f-4f8f-ac84-a00ae103aa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84717fb5-c84f-4f8f-ac84-a00ae103aa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a9640bd-7bbc-4f4d-8901-00e22675fdb7', 'volume_name': 'volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7', 'volume_size': 1, 'snapshot_id': '53164bce-e138-445a-bda3-e9b9b7bbc722'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c4fa3d-4ee8-4282-9553-6d1ca9e91e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c4fa3d-4ee8-4282-9553-6d1ca9e91e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73918ee4-be5d-488a-a761-26c5685c665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:23 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Volume 8a9640bd-7bbc-4f4d-8901-00e22675fdb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7', 'volume_size': 1, 'snapshot_id': '53164bce-e138-445a-bda3-e9b9b7bbc722'} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-53164bce-e138-445a-bda3-e9b9b7bbc722-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-53164bce-e138-445a-bda3-e9b9b7bbc722-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Creating volume 8a9640bd-7bbc-4f4d-8901-00e22675fdb7 from snapshot 53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] snapshot: 53164bce-e138-445a-bda3-e9b9b7bbc722, volume: 8a9640bd-7bbc-4f4d-8901-00e22675fdb7, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d0d96-0b88-422f-bb26-10986c0b4743]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:23 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 Sep 05 20:50:23 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:23 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722" returned: 0 in 0.410s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab5c4258-3563-402e-9324-be7e53aa3ccf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[351bd4a5-7104-4ea9-a529-fb7e46d3fadc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:23 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf Sep 05 20:50:23 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:24 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf" returned: 0 in 0.443s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 20:50:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 20:50:24 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:50:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:24 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 Sep 05 20:50:24 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:31 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" returned: 0 in 7.560s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:50:31 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Converted 1024.00 MB image at 135.42 MB/s Sep 05 20:50:31 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 is being set with open permissions: ugo+rw Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:31 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 Sep 05 20:50:31 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Flow 'volume_create_manager' (5faec4ff-d1c6-480c-9328-753223c9e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c882858-0fbd-4135-9831-e242ed4cd14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c882858-0fbd-4135-9831-e242ed4cd14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-30984055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195b2106-41ef-4468-8e45-26ee43a10df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a79580e821422b850a2db9bf03b51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:32Z,use_quota=True,user_id='e4c16e728c0f4a98bd907f5d57fb2ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9135d7-5459-47b8-b5af-69fb0eaa897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9135d7-5459-47b8-b5af-69fb0eaa897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49bbd7b-8060-4e1b-a5be-8a4cfac8193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49bbd7b-8060-4e1b-a5be-8a4cfac8193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '195b2106-41ef-4468-8e45-26ee43a10df8', 'volume_name': 'volume-195b2106-41ef-4468-8e45-26ee43a10df8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ec7c89-ae49-4a02-807a-289bdfbeca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ec7c89-ae49-4a02-807a-289bdfbeca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd8fd0a-fd70-4be1-a6cd-b0a361f7fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:31 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Volume 195b2106-41ef-4468-8e45-26ee43a10df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-195b2106-41ef-4468-8e45-26ee43a10df8', 'volume_size': 1} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:31 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" returned: 0 in 0.343s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" released by "_copy_volume_from_snapshot" :: held 8.837s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-53164bce-e138-445a-bda3-e9b9b7bbc722-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" released by "_create_volume_from_snapshot" :: held 8.911s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.926s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-30984055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195b2106-41ef-4468-8e45-26ee43a10df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a79580e821422b850a2db9bf03b51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:32Z,use_quota=True,user_id='e4c16e728c0f4a98bd907f5d57fb2ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Creating volume 195b2106-41ef-4468-8e45-26ee43a10df8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:50:32 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73918ee4-be5d-488a-a761-26c5685c665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7', 'volume_size': 1, 'snapshot_id': '53164bce-e138-445a-bda3-e9b9b7bbc722'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25876ee6-18a7-4cf1-b5f8-c2302a62daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:32 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 1073741824 Sep 05 20:50:32 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Volume volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 (8a9640bd-7bbc-4f4d-8901-00e22675fdb7): created successfully Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25876ee6-18a7-4cf1-b5f8-c2302a62daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Flow 'volume_create_manager' (e664fe13-fd65-49bc-8624-9a5e64f4f789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f9c0dce9-ed81-4b72-a5bc-17d9e215b141 tempest-VolumesDeleteCascade-2061476054 None] Created volume successfully. Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-ab5c4258-3563-402e-9324-be7e53aa3ccf-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-ab5c4258-3563-402e-9324-be7e53aa3ccf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:32 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 1073741824" returned: 0 in 0.637s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Performing cascade delete. {{(pid=87778) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-53164bce-e138-445a-bda3-e9b9b7bbc722-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-53164bce-e138-445a-bda3-e9b9b7bbc722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-ab5c4258-3563-402e-9324-be7e53aa3ccf" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-ab5c4258-3563-402e-9324-be7e53aa3ccf" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-53164bce-e138-445a-bda3-e9b9b7bbc722" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:32 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-53164bce-e138-445a-bda3-e9b9b7bbc722" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:32 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Deleting offline snapshot 53164bce-e138-445a-bda3-e9b9b7bbc722 of volume ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] snapshot_file for this snap is: volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c50955-4f01-4dea-a98e-30e4ace0cd43]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:33 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 Sep 05 20:50:33 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:33 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8" returned: 0 in 0.324s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd8fd0a-fd70-4be1-a6cd-b0a361f7fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195b2106-41ef-4468-8e45-26ee43a10df8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c5636e-870d-4a0d-971c-d4733deddde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Volume volume-195b2106-41ef-4468-8e45-26ee43a10df8 (195b2106-41ef-4468-8e45-26ee43a10df8): created successfully Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c5636e-870d-4a0d-971c-d4733deddde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Flow 'volume_create_manager' (5faec4ff-d1c6-480c-9328-753223c9e39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:33 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ae9707ed-606c-433d-bfbc-94a4df20b97a tempest-AttachVolumeNegativeTest-1548556985 None] Created volume successfully. Sep 05 20:50:33 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722" returned: 0 in 0.472s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab5c4258-3563-402e-9324-be7e53aa3ccf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69aded1-c10c-4c91-94ad-9937e9fa9ebb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:33 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf Sep 05 20:50:33 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:33 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf" returned: 0 in 0.599s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:34 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 Sep 05 20:50:34 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:34 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722" returned: 0 in 0.504s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:34 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722 Sep 05 20:50:34 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-06d5fc24-3fdd-42a1-ba73-778eaca8be6d req-51726a1d-f5f3-4ace-8613-8a13ea268689 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-06d5fc24-3fdd-42a1-ba73-778eaca8be6d req-51726a1d-f5f3-4ace-8613-8a13ea268689 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-06d5fc24-3fdd-42a1-ba73-778eaca8be6d req-51726a1d-f5f3-4ace-8613-8a13ea268689 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-06d5fc24-3fdd-42a1-ba73-778eaca8be6d req-51726a1d-f5f3-4ace-8613-8a13ea268689 tempest-AttachVolumeNegativeTest-1548556985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-195b2106-41ef-4468-8e45-26ee43a10df8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5c67086-e378-4c4a-983f-0a5fce5fbcac', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:50:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-06d5fc24-3fdd-42a1-ba73-778eaca8be6d req-51726a1d-f5f3-4ace-8613-8a13ea268689 tempest-AttachVolumeNegativeTest-1548556985 None] attachment_update completed successfully. Sep 05 20:50:34 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf.53164bce-e138-445a-bda3-e9b9b7bbc722" returned: 0 in 0.336s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-53164bce-e138-445a-bda3-e9b9b7bbc722" released by "_delete_snapshot" :: held 2.063s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-ab5c4258-3563-402e-9324-be7e53aa3ccf" released by "delete_snapshot" :: held 2.092s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:34 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Created reservations ['56a1c7b5-b934-4da1-b93f-f011db238475', '7f6f3a3b-de3c-4820-9deb-32984a583928', '22e18e1c-142a-485e-a58c-f3e0ff67c928', '53101d97-c74b-42a8-afdd-0d00ae75c17d'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:35 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Delete snapshot completed successfully. Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-53164bce-e138-445a-bda3-e9b9b7bbc722-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Snapshots deleted, issuing volume delete {{(pid=87778) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-ab5c4258-3563-402e-9324-be7e53aa3ccf" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-ab5c4258-3563-402e-9324-be7e53aa3ccf" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1434cd-9c12-44ba-a21a-b388b2fcd805]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:35 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf Sep 05 20:50:35 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:35 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf" returned: 0 in 0.651s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:35 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf Sep 05 20:50:35 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:36 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ab5c4258-3563-402e-9324-be7e53aa3ccf" returned: 0 in 0.453s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-ab5c4258-3563-402e-9324-be7e53aa3ccf" released by "delete_volume" :: held 1.217s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Created reservations ['5c34777f-d576-4aed-9835-f16375fab306', '42e51b75-1a92-4b0a-b50d-c3579755ab73', 'fa9e1526-e98f-48c4-a157-6315852cd4a2', 'f559e72a-134a-4924-b49b-03a0ece1ff10'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:36 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:50:36 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:36 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.466s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:36 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Deleted volume successfully. Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-95334507-c6bb-4147-9796-812ad542364e tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-ab5c4258-3563-402e-9324-be7e53aa3ccf-delete_volume" released by "delete_volume" :: held 4.375s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-8a9640bd-7bbc-4f4d-8901-00e22675fdb7-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-8a9640bd-7bbc-4f4d-8901-00e22675fdb7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=62,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "cinder-quobyte-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" acquired by "delete_volume" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8662b6b2-ac85-45f9-a9af-9a5c23c717f8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:37 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 Sep 05 20:50:37 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:38 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" returned: 0 in 0.525s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:38 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7 Sep 05 20:50:38 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:38 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" returned: 0 in 0.368s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-quobyte-8a9640bd-7bbc-4f4d-8901-00e22675fdb7" released by "delete_volume" :: held 0.973s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-40cc408c-c9ef-490f-bd38-a9e1f24b31f3 req-8d4af91f-3d7d-475e-862d-43b3d2012461 tempest-AttachVolumeShelveTestJSON-1563099460 None] No connector for attachment cfd245a7-01b9-4f13-8e02-7b4f38039eb1; skipping storage backend terminate_connection call. {{(pid=87778) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-40cc408c-c9ef-490f-bd38-a9e1f24b31f3 req-8d4af91f-3d7d-475e-862d-43b3d2012461 tempest-AttachVolumeShelveTestJSON-1563099460 None] Deleting attachment cfd245a7-01b9-4f13-8e02-7b4f38039eb1. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Created reservations ['211b7c21-a3dc-45c1-b30d-70dd5e2b9e92', 'd440a3f6-0ac1-4a96-931f-af636e1bb5d1', '8bcc9017-5f3a-4f85-9def-9b34e863d313', '28cbfdbf-f530-496b-86b0-97774c22816b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:38 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:50:38 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:39 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.268s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:39 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:50:39 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Deleted volume successfully. Sep 05 20:50:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-759d0637-bf54-435d-85b7-f04c5570a946 tempest-VolumesDeleteCascade-2061476054 None] Lock "cinder-8a9640bd-7bbc-4f4d-8901-00e22675fdb7-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:50:46 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:50:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Flow 'volume_create_manager' (62035082-5365-4d3f-8161-e51f67a6502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1408b51-64d3-49f2-9d65-5bb72b3574fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:46 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=61,cinder:UPDATE=67,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1408b51-64d3-49f2-9d65-5bb72b3574fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-130372624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ab1aad-c4b6-4410-bb26-2a121aac93a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1457c68fb17a439da3a591e781d04504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:47Z,use_quota=True,user_id='86af933c01e6401da9d6ee5bc4cd31e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa640ee8-f0ff-400a-94f3-08a7e8be2972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa640ee8-f0ff-400a-94f3-08a7e8be2972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70728191-1965-42cb-9411-63c1d8e6b2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70728191-1965-42cb-9411-63c1d8e6b2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '61ab1aad-c4b6-4410-bb26-2a121aac93a1', 'volume_name': 'volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8e0609-850d-4d69-a203-c86001ebeef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8e0609-850d-4d69-a203-c86001ebeef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f02f02-93bc-4146-8db1-68cb2a85d18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Volume 61ab1aad-c4b6-4410-bb26-2a121aac93a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 20:50:47 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Trying to clone 61ab1aad-c4b6-4410-bb26-2a121aac93a1 from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 20:50:48 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 20:50:48 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Image download 20.69 MB at 20.69 MB/s Sep 05 20:50:48 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eec6f6-ea37-4823-8dff-47e4bf0360bc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:48 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD Sep 05 20:50:48 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:48 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:48 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 is fetched for user 86af933c01e6401da9d6ee5bc4cd31e8. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 20:50:48 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3b3400-fb11-43d9-9cb6-a33952f7ffc9]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:49 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD Sep 05 20:50:49 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:49 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-130372624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ab1aad-c4b6-4410-bb26-2a121aac93a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1457c68fb17a439da3a591e781d04504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:50:47Z,use_quota=True,user_id='86af933c01e6401da9d6ee5bc4cd31e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Creating volume 61ab1aad-c4b6-4410-bb26-2a121aac93a1 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:50:49 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:50:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:49 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 1073741824 Sep 05 20:50:49 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:50 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 1073741824" returned: 0 in 0.668s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:50 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 Sep 05 20:50:50 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:50 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Attempting download of 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 61ab1aad-c4b6-4410-bb26-2a121aac93a1. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9ed70-c8d5-49a4-aa71-4fe04eb019ad]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_1kzidjbh {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:50 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_1kzidjbh Sep 05 20:50:50 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:51 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_1kzidjbh" returned: 0 in 0.549s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_1kzidjbh {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:51 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_1kzidjbh Sep 05 20:50:51 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:51 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_1kzidjbh" returned: 1 in 0.652s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_1kzidjbh' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:50:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20780f-4070-48bb-a440-1908f8d33cc7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:51 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD Sep 05 20:50:51 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:52 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:52 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] 1e185b14-4f13-44ff-ab1c-d13d5db83085 was qcow2, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 20:50:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:52 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 Sep 05 20:50:52 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:55 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1" returned: 0 in 3.601s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:55 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085__bikk98kdevstack@QuobyteHD, size 112.00 MB, duration 3.60 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:50:55 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Converted 112.00 MB image at 31.09 MB/s Sep 05 20:50:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:55 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 1G Sep 05 20:50:55 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:56 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 1G" returned: 0 in 0.450s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Downloaded image 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 61ab1aad-c4b6-4410-bb26-2a121aac93a1 successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 for user 86af933c01e6401da9d6ee5bc4cd31e8 is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Marking volume 61ab1aad-c4b6-4410-bb26-2a121aac93a1 as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Copying metadata from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 to 61ab1aad-c4b6-4410-bb26-2a121aac93a1. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Creating volume glance metadata for volume 61ab1aad-c4b6-4410-bb26-2a121aac93a1 backed by image 1e185b14-4f13-44ff-ab1c-d13d5db83085 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f02f02-93bc-4146-8db1-68cb2a85d18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecf9c8b-788f-4726-b782-0a58e10baa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:50:56 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Volume volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 (61ab1aad-c4b6-4410-bb26-2a121aac93a1): created successfully Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecf9c8b-788f-4726-b782-0a58e10baa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:50:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Flow 'volume_create_manager' (62035082-5365-4d3f-8161-e51f67a6502c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:50:56 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c903bf1a-c238-4bc8-bd6a-b2dd62f62bf8 tempest-VolumesExtendTest-1468559047 None] Created volume successfully. Sep 05 20:50:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:50:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:50:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc394454-ed27-4b95-a866-eb0d25f647ff]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:50:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:58 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 Sep 05 20:50:58 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:50:58 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Sep 05 20:50:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1" returned: 0 in 0.922s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 2G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:50:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 2G" returned: 0 in 0.565s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:50:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.667s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:50:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ee80b359-9cb9-4f81-937f-03b11a6d7743 tempest-VolumesExtendTest-1468559047 None] Extend volume completed successfully. Sep 05 20:51:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Acquiring lock "cinder-61ab1aad-c4b6-4410-bb26-2a121aac93a1-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Lock "cinder-61ab1aad-c4b6-4410-bb26-2a121aac93a1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Acquiring lock "cinder-quobyte-61ab1aad-c4b6-4410-bb26-2a121aac93a1" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-61ab1aad-c4b6-4410-bb26-2a121aac93a1" acquired by "delete_volume" :: waited 0.050s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:01 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[403b429c-1bab-4fd9-b586-0ba6ed09138e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:01 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 Sep 05 20:51:01 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:02 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1" returned: 0 in 0.713s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:02 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1 Sep 05 20:51:02 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-ecd0f22a-ba7b-42bd-a1a7-ef4cd6eeeba6 req-8f90ba6d-a860-4f24-9af5-e027ce529f9c tempest-TaggedAttachmentsTest-850058772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-ecd0f22a-ba7b-42bd-a1a7-ef4cd6eeeba6 req-8f90ba6d-a860-4f24-9af5-e027ce529f9c tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-ecd0f22a-ba7b-42bd-a1a7-ef4cd6eeeba6 req-8f90ba6d-a860-4f24-9af5-e027ce529f9c tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:02 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-61ab1aad-c4b6-4410-bb26-2a121aac93a1" returned: 0 in 0.438s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-61ab1aad-c4b6-4410-bb26-2a121aac93a1" released by "delete_volume" :: held 1.221s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-ecd0f22a-ba7b-42bd-a1a7-ef4cd6eeeba6 req-8f90ba6d-a860-4f24-9af5-e027ce529f9c tempest-TaggedAttachmentsTest-850058772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-dc13cc21-7b4d-456e-b30e-df369f77930b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3c46f0c-5e6e-429f-8266-fbe9247500dc', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Created reservations ['8aa6148d-96a8-490e-b95b-f1352e914683', '160aea4a-a9b8-4672-bf61-33007e2e81f6', 'a65d1eba-e614-4b99-b54a-407e3375073c', '157526ce-2959-412c-a1ff-4d972cb57dab'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-ecd0f22a-ba7b-42bd-a1a7-ef4cd6eeeba6 req-8f90ba6d-a860-4f24-9af5-e027ce529f9c tempest-TaggedAttachmentsTest-850058772 None] attachment_update completed successfully. Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:02 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:51:02 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:03 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.412s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:03 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Deleted volume successfully. Sep 05 20:51:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856e0583-d0b9-45c0-a739-47dc45f7045d tempest-VolumesExtendTest-1468559047 None] Lock "cinder-61ab1aad-c4b6-4410-bb26-2a121aac93a1-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Flow 'volume_create_manager' (c6af0888-82e8-4816-aaf5-db846b16b09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78a605f-7870-4638-bc8c-ce68e4eaf800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c78a605f-7870-4638-bc8c-ce68e4eaf800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1734549188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294e03c8-b118-417a-8219-8c2772268ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1457c68fb17a439da3a591e781d04504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:04Z,use_quota=True,user_id='86af933c01e6401da9d6ee5bc4cd31e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2887a00-3d1a-4ab9-9823-2688e5dea482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2887a00-3d1a-4ab9-9823-2688e5dea482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925fd64-dee6-4ab2-b429-b1c0cdb520d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a925fd64-dee6-4ab2-b429-b1c0cdb520d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294e03c8-b118-417a-8219-8c2772268ab9', 'volume_name': 'volume-294e03c8-b118-417a-8219-8c2772268ab9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fa0a9e-d1fc-4836-ac1b-42f545d7a86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fa0a9e-d1fc-4836-ac1b-42f545d7a86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b15665-5480-448f-ae8b-5bac1028f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:04 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Volume 294e03c8-b118-417a-8219-8c2772268ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294e03c8-b118-417a-8219-8c2772268ab9', 'volume_size': 1} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1734549188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294e03c8-b118-417a-8219-8c2772268ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1457c68fb17a439da3a591e781d04504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:04Z,use_quota=True,user_id='86af933c01e6401da9d6ee5bc4cd31e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Creating volume 294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:51:04 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:04 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 1073741824 Sep 05 20:51:04 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:04 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 1073741824" returned: 0 in 0.540s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:04 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:51:04 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:04 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 Sep 05 20:51:04 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:05 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.343s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:51:05 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9" returned: 0 in 0.387s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b15665-5480-448f-ae8b-5bac1028f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294e03c8-b118-417a-8219-8c2772268ab9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e53c141-f16e-41e1-90af-cfdc955c7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:05 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Volume volume-294e03c8-b118-417a-8219-8c2772268ab9 (294e03c8-b118-417a-8219-8c2772268ab9): created successfully Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e53c141-f16e-41e1-90af-cfdc955c7802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Flow 'volume_create_manager' (c6af0888-82e8-4816-aaf5-db846b16b09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7d1ff925-b57f-49c8-83fb-e6a9a0cbaf6d tempest-VolumesExtendTest-1468559047 None] Created volume successfully. Sep 05 20:51:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-b5634842-0a3f-4146-87fd-a879603cf9d4 req-d9b62ce2-b8f7-4fe0-b4e5-92e142b4fc2d tempest-TaggedAttachmentsTest-850058772 None] Terminate volume connection completed successfully. Sep 05 20:51:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-b5634842-0a3f-4146-87fd-a879603cf9d4 req-d9b62ce2-b8f7-4fe0-b4e5-92e142b4fc2d tempest-TaggedAttachmentsTest-850058772 None] Deleting attachment d3c46f0c-5e6e-429f-8266-fbe9247500dc. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:51:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Creating offline snapshot 4c597ea2-3280-4f3a-9086-e1e6dd527684 of volume 294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:51:06 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f5474d-829f-40ee-8d69-f3fb7d5335b1]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:06 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 Sep 05 20:51:06 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:07 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9" returned: 0 in 0.559s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:07 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 1G Sep 05 20:51:07 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:08 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 1G" returned: 0 in 0.930s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294e03c8-b118-417a-8219-8c2772268ab9 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:08 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294e03c8-b118-417a-8219-8c2772268ab9 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 Sep 05 20:51:08 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:08 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-294e03c8-b118-417a-8219-8c2772268ab9 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684" returned: 0 in 0.474s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:08 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 is being set with open permissions: ugo+rw Sep 05 20:51:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:08 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 Sep 05 20:51:08 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:09 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:09 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.info Sep 05 20:51:09 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:09 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.info" returned: 0 in 0.321s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:09 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.info is being set with open permissions: ugo+rw Sep 05 20:51:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:09 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.info Sep 05 20:51:09 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:09 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.info" returned: 0 in 0.307s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.175s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-89f634bb-7578-4a28-800c-d04094a137e3 tempest-VolumesExtendTest-1468559047 None] Create snapshot completed successfully Sep 05 20:51:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c819688-fecd-45eb-9f72-dcb2d4f5b8a1]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:11 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 Sep 05 20:51:11 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:12 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9" returned: 0 in 0.809s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 2G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 2G" returned: 0 in 0.322s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.200s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:12 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-30b23640-0f3d-45b6-a4c8-4a570a3d5e9f tempest-VolumesExtendTest-1468559047 None] Extend volume completed successfully. Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Acquiring lock "cinder-4c597ea2-3280-4f3a-9086-e1e6dd527684-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Lock "cinder-4c597ea2-3280-4f3a-9086-e1e6dd527684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Acquiring lock "cinder-quobyte-294e03c8-b118-417a-8219-8c2772268ab9" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-294e03c8-b118-417a-8219-8c2772268ab9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Acquiring lock "cinder-quobyte-4c597ea2-3280-4f3a-9086-e1e6dd527684" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-4c597ea2-3280-4f3a-9086-e1e6dd527684" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Deleting offline snapshot 4c597ea2-3280-4f3a-9086-e1e6dd527684 of volume 294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] snapshot_file for this snap is: volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b5f10a-0cbc-493f-8d1d-7effc1fe9296]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:13 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 Sep 05 20:51:13 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:14 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684" returned: 0 in 0.460s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-294e03c8-b118-417a-8219-8c2772268ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:51:14 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dcc1c0-d3da-419d-97ac-a340726536b6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:14 devstack sudo[91029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 Sep 05 20:51:14 devstack sudo[91029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:14 devstack sudo[91029]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9" returned: 0 in 0.451s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:14 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 Sep 05 20:51:14 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:15 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:15 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684 Sep 05 20:51:15 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:15 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9.4c597ea2-3280-4f3a-9086-e1e6dd527684" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-4c597ea2-3280-4f3a-9086-e1e6dd527684" released by "_delete_snapshot" :: held 1.695s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-294e03c8-b118-417a-8219-8c2772268ab9" released by "delete_snapshot" :: held 1.719s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Created reservations ['9aa390bc-7a40-45ed-a6b1-e90b7831f607', 'b9c6e46d-4a1c-458f-8d6f-4bf15cc2af96', '500ed7dd-b8de-406f-a10c-345606e08828', 'c46be053-016e-4315-a041-48598820e4ac'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Delete snapshot completed successfully. Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6c5f51c5-0f9f-41a7-8aac-7592e9107d26 tempest-VolumesExtendTest-1468559047 None] Lock "cinder-4c597ea2-3280-4f3a-9086-e1e6dd527684-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Acquiring lock "cinder-294e03c8-b118-417a-8219-8c2772268ab9-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Lock "cinder-294e03c8-b118-417a-8219-8c2772268ab9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Acquiring lock "cinder-quobyte-294e03c8-b118-417a-8219-8c2772268ab9" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-294e03c8-b118-417a-8219-8c2772268ab9" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[add31a62-301a-450d-88db-207fc69ebe21]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:16 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 Sep 05 20:51:16 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Acquiring lock "cinder-dc13cc21-7b4d-456e-b30e-df369f77930b-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Lock "cinder-dc13cc21-7b4d-456e-b30e-df369f77930b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Acquiring lock "cinder-quobyte-dc13cc21-7b4d-456e-b30e-df369f77930b" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Lock "cinder-quobyte-dc13cc21-7b4d-456e-b30e-df369f77930b" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dab7fc-8680-422a-9857-af588a19d477]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:16 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9" returned: 0 in 0.422s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:16 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9 Sep 05 20:51:16 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:16 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b Sep 05 20:51:16 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:16 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-294e03c8-b118-417a-8219-8c2772268ab9" returned: 0 in 0.279s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Lock "cinder-quobyte-294e03c8-b118-417a-8219-8c2772268ab9" released by "delete_volume" :: held 0.771s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Created reservations ['d5878c58-331c-4bdd-8ade-19e5172b6dd5', 'fb2d3b14-409c-402f-9d6c-24c101ff51f1', 'd12e0db8-cfa6-4fa3-adce-f98a1a4b4abb', '31efaa1d-910f-4584-a8a2-8f2d6ff94885'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:16 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b" returned: 0 in 0.415s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:16 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b Sep 05 20:51:16 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:16 devstack sudo[91065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:51:16 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:17 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dc13cc21-7b4d-456e-b30e-df369f77930b" returned: 0 in 0.358s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Lock "cinder-quobyte-dc13cc21-7b4d-456e-b30e-df369f77930b" released by "delete_volume" :: held 0.827s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:17 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Deleted volume successfully. Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5f5094f5-0cc7-4f3b-8d91-1d1f5a90b8ea tempest-VolumesExtendTest-1468559047 None] Lock "cinder-294e03c8-b118-417a-8219-8c2772268ab9-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Created reservations ['e432e588-612a-4ae2-b47a-ec3022f83288', 'eab274c9-a623-4238-8602-0dcedf567f2f', '366d8a24-8067-4b6f-9d42-465258179c2f', '3317586f-6974-4cbd-8b4e-706554c5646f'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:17 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:51:17 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:17 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.327s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Deleted volume successfully. Sep 05 20:51:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a0d214f0-db2e-441c-8bc7-8f04f3d9299b tempest-TaggedAttachmentsTest-850058772 None] Lock "cinder-dc13cc21-7b4d-456e-b30e-df369f77930b-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-62073434-5e4b-4f75-a9a6-2e33890d204a req-9e22f53c-222d-4100-8bc1-87843b3743b2 tempest-AttachVolumeNegativeTest-1548556985 None] Terminate volume connection completed successfully. Sep 05 20:51:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-62073434-5e4b-4f75-a9a6-2e33890d204a req-9e22f53c-222d-4100-8bc1-87843b3743b2 tempest-AttachVolumeNegativeTest-1548556985 None] Deleting attachment f5c67086-e378-4c4a-983f-0a5fce5fbcac. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Flow 'volume_create_manager' (25861dc6-d637-4d14-8bab-434a0473c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7401c12c-5a9c-45cb-b9c1-e2a9090d0dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7401c12c-5a9c-45cb-b9c1-e2a9090d0dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1338049500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc811d-209e-401c-b10f-fd5d7c1c478d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b752fb345e497bb48ced8c1b0d2aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:26Z,use_quota=True,user_id='1b5e8c3cbd5141fb84204aabd434041d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d0338b-492e-4fe8-8277-0c1cde656820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d0338b-492e-4fe8-8277-0c1cde656820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c482a96-72e5-49d9-8202-7e6cb81bebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c482a96-72e5-49d9-8202-7e6cb81bebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3dc811d-209e-401c-b10f-fd5d7c1c478d', 'volume_name': 'volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d05d530-8708-4233-bfd4-e355c7e60c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d05d530-8708-4233-bfd4-e355c7e60c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d128b61c-0c3d-4fd2-99f9-a41a68d8396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:25 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Volume a3dc811d-209e-401c-b10f-fd5d7c1c478d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d', 'volume_size': 1} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1338049500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dc811d-209e-401c-b10f-fd5d7c1c478d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b752fb345e497bb48ced8c1b0d2aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:51:26Z,use_quota=True,user_id='1b5e8c3cbd5141fb84204aabd434041d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Creating volume a3dc811d-209e-401c-b10f-fd5d7c1c478d {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:51:25 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:51:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:25 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d 1073741824 Sep 05 20:51:25 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:26 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d 1073741824" returned: 0 in 0.540s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:26 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d Sep 05 20:51:26 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:26 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d" returned: 0 in 0.297s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d128b61c-0c3d-4fd2-99f9-a41a68d8396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77d1545-2f0e-46fa-9bf7-88dcfac550a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:51:26 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Volume volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d (a3dc811d-209e-401c-b10f-fd5d7c1c478d): created successfully Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77d1545-2f0e-46fa-9bf7-88dcfac550a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:51:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Flow 'volume_create_manager' (25861dc6-d637-4d14-8bab-434a0473c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:51:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3695ffbc-0045-4a1a-9a67-df13334c9b14 tempest-VolumesNegativeTest-2058071760 None] Created volume successfully. Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Acquiring lock "cinder-fa014a7e-093b-4757-b3b1-ffec55f6d8e4-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "cinder-fa014a7e-093b-4757-b3b1-ffec55f6d8e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Acquiring lock "cinder-quobyte-fa014a7e-093b-4757-b3b1-ffec55f6d8e4" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "cinder-quobyte-fa014a7e-093b-4757-b3b1-ffec55f6d8e4" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf5b999-c9f3-4d2b-af15-588e43ea2352]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:30 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 Sep 05 20:51:30 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:30 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4" returned: 0 in 0.474s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:30 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4 Sep 05 20:51:30 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:31 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa014a7e-093b-4757-b3b1-ffec55f6d8e4" returned: 0 in 0.365s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "cinder-quobyte-fa014a7e-093b-4757-b3b1-ffec55f6d8e4" released by "delete_volume" :: held 0.930s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Created reservations ['a67c9a86-caad-4818-9988-897478210e60', '12fcfb04-9c7d-404b-8e8b-33dc7d6adcc2', '1bf953b1-b4b2-4f45-a252-9c51591fb3ac', '189df315-8a6b-487e-a540-e00a7ee32660'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:51:31 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:51:31 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:51:31 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.387s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:51:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Deleted volume successfully. Sep 05 20:51:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dba5f96c-2402-47f6-8446-c42da6a439d2 tempest-AttachVolumeShelveTestJSON-1563099460 None] Lock "cinder-fa014a7e-093b-4757-b3b1-ffec55f6d8e4-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:51:41 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=56,cinder:UPDATE=60,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:51:41 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=53,cinder:INSERT=27,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:51:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f363f543-09d4-4abb-9405-28a30c516901 tempest-BackendsCapabilitiesAdminTestsJSON-1871435038 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.656494140625, 'free_capacity_gb': 1773.656494140625, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87778) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 20:51:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6cf6f1d2-0f44-4176-b0c5-b9dad6e2330f tempest-BackendsCapabilitiesAdminTestsJSON-1871435038 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.656494140625, 'free_capacity_gb': 1773.656494140625, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87778) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 20:51:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2132b8d7-a2a4-4c97-bdf7-32e5a7ebb66f tempest-GroupsV314Test-496857206 None] Group tempest-GroupsV314Test-Group-2055115160: creating Sep 05 20:51:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2132b8d7-a2a4-4c97-bdf7-32e5a7ebb66f tempest-GroupsV314Test-496857206 None] Group tempest-GroupsV314Test-Group-2055115160: created successfully Sep 05 20:51:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2132b8d7-a2a4-4c97-bdf7-32e5a7ebb66f tempest-GroupsV314Test-496857206 None] Create group completed successfully. Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Flow 'volume_create_manager' (f79e3033-35f3-4529-ad38-9ba9cc2bd20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78124ac0-b4e3-4c9c-9b99-cc5e7fdaa5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78124ac0-b4e3-4c9c-9b99-cc5e7fdaa5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-19683703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6487f022-594a-4bbc-854b-8506f4558c29,host='devstack@QuobyteHD#QuobyteHD',id=bd1b9703-6a41-48d1-a4d4-aa5603037975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fe741f048543a7a6b356c11a0a6c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:02Z,use_quota=True,user_id='13d60c953862447b9efb4a2d0d936853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfb9aa58-90a0-4bf0-9ee7-06bbaec47879),volume_type_id=dfb9aa58-90a0-4bf0-9ee7-06bbaec47879)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e94ab7d-e4ac-4411-9058-d8b422e8ad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e94ab7d-e4ac-4411-9058-d8b422e8ad4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed84d8e-ac66-4409-a9cd-0d30b3d441ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed84d8e-ac66-4409-a9cd-0d30b3d441ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1b9703-6a41-48d1-a4d4-aa5603037975', 'volume_name': 'volume-bd1b9703-6a41-48d1-a4d4-aa5603037975', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2087f2b-e913-4fa8-95f6-323979811ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2087f2b-e913-4fa8-95f6-323979811ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf95606-8f96-4a07-bd33-1ea792cfa93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Volume bd1b9703-6a41-48d1-a4d4-aa5603037975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1b9703-6a41-48d1-a4d4-aa5603037975', 'volume_size': 1} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6487f022-594a-4bbc-854b-8506f4558c29,created_at=2026-09-05T18:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-19683703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6487f022-594a-4bbc-854b-8506f4558c29,host='devstack@QuobyteHD#QuobyteHD',id=bd1b9703-6a41-48d1-a4d4-aa5603037975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fe741f048543a7a6b356c11a0a6c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:02Z,use_quota=True,user_id='13d60c953862447b9efb4a2d0d936853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfb9aa58-90a0-4bf0-9ee7-06bbaec47879),volume_type_id=dfb9aa58-90a0-4bf0-9ee7-06bbaec47879)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Creating volume bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:52:02 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Acquiring lock "cinder-a3dc811d-209e-401c-b10f-fd5d7c1c478d-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:02 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 1073741824 Sep 05 20:52:02 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Lock "cinder-a3dc811d-209e-401c-b10f-fd5d7c1c478d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Acquiring lock "cinder-quobyte-a3dc811d-209e-401c-b10f-fd5d7c1c478d" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Lock "cinder-quobyte-a3dc811d-209e-401c-b10f-fd5d7c1c478d" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad379c40-5ce5-41fc-8eca-f22123fc63fe]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:02 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d Sep 05 20:52:02 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:02 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d" returned: 0 in 0.535s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:02 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 1073741824" returned: 0 in 0.785s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:03 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d Sep 05 20:52:03 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:03 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 Sep 05 20:52:03 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:03 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a3dc811d-209e-401c-b10f-fd5d7c1c478d" returned: 0 in 0.449s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Lock "cinder-quobyte-a3dc811d-209e-401c-b10f-fd5d7c1c478d" released by "delete_volume" :: held 1.058s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:03 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975" returned: 0 in 0.448s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf95606-8f96-4a07-bd33-1ea792cfa93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1b9703-6a41-48d1-a4d4-aa5603037975', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2802c6-f197-49dd-b7fc-92d99e291227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Volume volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 (bd1b9703-6a41-48d1-a4d4-aa5603037975): created successfully Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2802c6-f197-49dd-b7fc-92d99e291227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Flow 'volume_create_manager' (f79e3033-35f3-4529-ad38-9ba9cc2bd20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Created reservations ['2f6268a4-6c5a-44db-b4b7-48e8af53865c', '968e6a68-b63c-44a2-aa08-5a94a27fced7', '46ed2f47-862a-4090-85fb-327a823a877e', '6ca7e015-b909-44f6-b7ee-99fe63fd65df'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4fa22012-00e0-46e4-85d1-6def6ca109bf tempest-GroupsV314Test-496857206 None] Created volume successfully. Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:03 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:52:03 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:03 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.272s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Deleted volume successfully. Sep 05 20:52:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b44232ed-df5c-4223-b398-e0574fe8951c tempest-VolumesNegativeTest-2058071760 None] Lock "cinder-a3dc811d-209e-401c-b10f-fd5d7c1c478d-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:52:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:04 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:52:04 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:05 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.386s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:05 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Cloning volume bd1b9703-6a41-48d1-a4d4-aa5603037975 to volume 280dc5e5-ca2a-44e8-b4eb-acb25f3176ff Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Creating offline snapshot fe1a542f-7125-4d5c-9b14-4dad052516a9 of volume bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33065c9-e93c-422a-8b31-f91b478e049f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:06 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 Sep 05 20:52:06 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:06 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975" returned: 0 in 0.565s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:06 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 1G Sep 05 20:52:06 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:07 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 1G" returned: 0 in 0.576s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:07 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 Sep 05 20:52:07 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:07 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9" returned: 0 in 0.508s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:07 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:07 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 Sep 05 20:52:07 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:07 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9" returned: 0 in 0.312s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:07 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.info Sep 05 20:52:07 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:08 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.info" returned: 0 in 0.352s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:08 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:08 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.info Sep 05 20:52:08 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:08 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.info" returned: 0 in 0.472s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Acquiring lock "cinder-quobyte-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] snapshot: fe1a542f-7125-4d5c-9b14-4dad052516a9, volume: 280dc5e5-ca2a-44e8-b4eb-acb25f3176ff, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[10916ae6-a9fe-4b1f-97ac-1b175d725abb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:09 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 Sep 05 20:52:09 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:09 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9" returned: 0 in 0.609s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1b9703-6a41-48d1-a4d4-aa5603037975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69e601-32cf-4aeb-bd55-06eeee20b279]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:09 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 Sep 05 20:52:09 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Flow 'volume_create_manager' (36946ff0-039f-497e-b584-5306c166c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53518865-3cdf-4b82-8c7a-a2b2da2d586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53518865-3cdf-4b82-8c7a-a2b2da2d586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2055752798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c5358-bba1-4d1f-ad50-43787f827453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44f8e17078e469eaa07e7c19af77072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:10Z,use_quota=True,user_id='5883249a5f034d338d907caa79fc7f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca65d250-46d5-47af-897c-99ba709b2a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca65d250-46d5-47af-897c-99ba709b2a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d75023d-b933-40b0-819d-efad96b35444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d75023d-b933-40b0-819d-efad96b35444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675c5358-bba1-4d1f-ad50-43787f827453', 'volume_name': 'volume-675c5358-bba1-4d1f-ad50-43787f827453', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3df778-c1e3-44b4-aba1-15e363a58d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3df778-c1e3-44b4-aba1-15e363a58d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37376687-77db-4b87-94e8-fef8ce212108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:10 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Volume 675c5358-bba1-4d1f-ad50-43787f827453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675c5358-bba1-4d1f-ad50-43787f827453', 'volume_size': 1} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:10 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975" returned: 0 in 0.743s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:52:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:10 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff Sep 05 20:52:10 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:17 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" returned: 0 in 7.107s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:17 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:52:17 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Converted 1024.00 MB image at 143.94 MB/s Sep 05 20:52:17 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:52:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:17 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff Sep 05 20:52:17 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:18 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" returned: 0 in 0.767s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" released by "_copy_volume_from_snapshot" :: held 9.394s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Acquiring lock "cinder-quobyte-fe1a542f-7125-4d5c-9b14-4dad052516a9" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Flow 'volume_create_manager' (5dc51e51-8c68-428f-b7bf-fe8546d70947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322f9ec4-841a-47dd-9aca-cd0dd295d714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-fe1a542f-7125-4d5c-9b14-4dad052516a9" acquired by "_delete_snapshot" :: waited 0.200s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Deleting offline snapshot fe1a542f-7125-4d5c-9b14-4dad052516a9 of volume bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] snapshot_file for this snap is: volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322f9ec4-841a-47dd-9aca-cd0dd295d714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-666358127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a79580e821422b850a2db9bf03b51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:18Z,use_quota=True,user_id='e4c16e728c0f4a98bd907f5d57fb2ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f97b04-533e-430c-b34f-1f2d06d386e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f97b04-533e-430c-b34f-1f2d06d386e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf34da4-49ab-401d-937f-1def2daf6e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf34da4-49ab-401d-937f-1def2daf6e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc', 'volume_name': 'volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4f5c4c-a52b-4044-a239-97a69d43bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4f5c4c-a52b-4044-a239-97a69d43bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43583e1-e500-465f-8d54-1ac2f7720e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Volume bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc', 'volume_size': 1} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60e1d2-c34e-4394-b2d2-cdc58393d576]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:18 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 Sep 05 20:52:18 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:19 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9" returned: 0 in 0.523s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1b9703-6a41-48d1-a4d4-aa5603037975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:19 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e019f1fc-89d6-4d4f-9226-bdfa8d527123]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:19 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 Sep 05 20:52:19 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:20 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975" returned: 0 in 0.730s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:20 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 Sep 05 20:52:20 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:20 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9" returned: 0 in 0.479s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:20 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9 Sep 05 20:52:20 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:20 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975.fe1a542f-7125-4d5c-9b14-4dad052516a9" returned: 0 in 0.382s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-fe1a542f-7125-4d5c-9b14-4dad052516a9" released by "_delete_snapshot" :: held 2.353s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.125s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.928s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2055752798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c5358-bba1-4d1f-ad50-43787f827453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44f8e17078e469eaa07e7c19af77072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:10Z,use_quota=True,user_id='5883249a5f034d338d907caa79fc7f25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Creating volume 675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:52:20 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:52:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:21 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 1073741824 Sep 05 20:52:21 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b64168ad-f94a-4b05-8417-f8d88946fc18 tempest-GroupsV314Test-496857206 None] Create group from source-group-6487f022-594a-4bbc-854b-8506f4558c29 completed successfully. Sep 05 20:52:21 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 1073741824" returned: 0 in 0.684s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:21 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 Sep 05 20:52:21 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:22 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453" returned: 0 in 0.335s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.357s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-666358127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a79580e821422b850a2db9bf03b51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:18Z,use_quota=True,user_id='e4c16e728c0f4a98bd907f5d57fb2ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Creating volume bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:52:22 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37376687-77db-4b87-94e8-fef8ce212108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675c5358-bba1-4d1f-ad50-43787f827453', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:22 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc 1073741824 Sep 05 20:52:22 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79814c3-86c2-4010-8892-0cbf6070a202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:22 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Volume volume-675c5358-bba1-4d1f-ad50-43787f827453 (675c5358-bba1-4d1f-ad50-43787f827453): created successfully Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79814c3-86c2-4010-8892-0cbf6070a202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Flow 'volume_create_manager' (36946ff0-039f-497e-b584-5306c166c39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bd434d86-ab01-4106-902c-83e3497909a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Created volume successfully. Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Acquiring lock "cinder-quobyte-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab7f79b-6947-4d7d-b454-b4590c1f71ff]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:23 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff Sep 05 20:52:23 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:23 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc 1073741824" returned: 0 in 0.980s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:23 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc Sep 05 20:52:23 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:23 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" returned: 0 in 0.553s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:23 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc" returned: 0 in 0.267s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] <== create_volume: return (1318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.528s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:23 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff Sep 05 20:52:23 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43583e1-e500-465f-8d54-1ac2f7720e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6314edd-eb1a-416d-a0b7-2193a247aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Creating offline snapshot ef570ed7-7add-4ce8-9e36-f289b0b70024 of volume 675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:23 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Volume volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc (bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc): created successfully Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6314edd-eb1a-416d-a0b7-2193a247aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Flow 'volume_create_manager' (5dc51e51-8c68-428f-b7bf-fe8546d70947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f3d8af-eba0-4ba5-9791-1fb81e16edac]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a7281dcb-a54e-4255-bbcf-6c31d781f4be tempest-AttachVolumeNegativeTest-1548556985 None] Created volume successfully. Sep 05 20:52:23 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 Sep 05 20:52:23 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:23 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" returned: 0 in 0.348s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-280dc5e5-ca2a-44e8-b4eb-acb25f3176ff" released by "delete_volume" :: held 0.956s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Created reservations ['05843cb8-c91d-408d-8580-29cc615d005e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:23 devstack cinder-volume[87778]: WARNING cinder.quota [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2105911838 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2105911838, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:23 devstack cinder-volume[87778]: WARNING cinder.quota [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2105911838 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2105911838, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:52:23 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Created reservations ['4f77625e-708e-4d1a-bf76-40ccb1300995', 'd4a3c2ee-fe30-4b0c-be06-10cc1b83d47c', '5abb2894-9f44-4f28-9aaf-354626740701', '6ed63992-08f5-4756-a89c-4a208afc4b6b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:24 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453" returned: 0 in 0.536s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:24 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 1G Sep 05 20:52:24 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:24 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:52:24 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:24 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fda32d22-82c5-4b9e-963e-04c1b8f79c96 tempest-GroupsV314Test-496857206 None] Delete group completed successfully. Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Acquiring lock "cinder-quobyte-bd1b9703-6a41-48d1-a4d4-aa5603037975" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-bd1b9703-6a41-48d1-a4d4-aa5603037975" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[baabbf43-757d-4789-8114-a0a9517b04a5]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:24 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 Sep 05 20:52:24 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:24 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 1G" returned: 0 in 0.729s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:24 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 Sep 05 20:52:24 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:25 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975" returned: 0 in 0.540s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:25 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975 Sep 05 20:52:25 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:25 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024" returned: 0 in 0.476s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:25 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 is being set with open permissions: ugo+rw Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:25 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 Sep 05 20:52:25 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:25 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd1b9703-6a41-48d1-a4d4-aa5603037975" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Lock "cinder-quobyte-bd1b9703-6a41-48d1-a4d4-aa5603037975" released by "delete_volume" :: held 0.974s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Created reservations ['8ad5208a-5e1e-49e9-9306-826b0d9e04f0'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Created reservations ['8a10af0d-00a4-456e-8306-80a4094df7ef', '3a5c985a-dfdd-41c2-b705-78433ae26d33', 'b7085f74-cf66-4973-bb88-4e79104dbf0a', 'c532c91f-a27a-4278-b448-f240b6ebeae7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:25 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024" returned: 0 in 0.419s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:25 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.info Sep 05 20:52:25 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-b7607358-41b9-4deb-bf17-3668aa435533 req-b19cc3ab-c065-44f5-b353-4dd2515d1ce6 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:25 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:52:25 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:26 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.info" returned: 0 in 0.366s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:26 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.info is being set with open permissions: ugo+rw Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:26 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.info Sep 05 20:52:26 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:26 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.346s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7e9d0bcd-96a4-457f-a0e8-13cc11f02aa9 tempest-GroupsV314Test-496857206 None] Delete group completed successfully. Sep 05 20:52:26 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.info" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-b7607358-41b9-4deb-bf17-3668aa435533 req-b19cc3ab-c065-44f5-b353-4dd2515d1ce6 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.581s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-b7607358-41b9-4deb-bf17-3668aa435533 req-b19cc3ab-c065-44f5-b353-4dd2515d1ce6 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-45fd8063-8193-4739-a8ad-80fe002e2ac2 tempest-VolumesSnapshotListTestJSON-2094321514 None] Create snapshot completed successfully Sep 05 20:52:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-b7607358-41b9-4deb-bf17-3668aa435533 req-b19cc3ab-c065-44f5-b353-4dd2515d1ce6 tempest-AttachVolumeNegativeTest-1548556985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fc29890-e325-44c5-8fc6-8de0c1344a04', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:52:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-b7607358-41b9-4deb-bf17-3668aa435533 req-b19cc3ab-c065-44f5-b353-4dd2515d1ce6 tempest-AttachVolumeNegativeTest-1548556985 None] attachment_update completed successfully. Sep 05 20:52:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Creating offline snapshot 8c7f4a88-7b82-4cd9-9163-1785ff376584 of volume 675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:27 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c843d38-913c-45ba-8dd7-d4c387d17bc7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:27 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 Sep 05 20:52:27 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:28 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024" returned: 0 in 0.624s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c5358-bba1-4d1f-ad50-43787f827453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:28 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 1G Sep 05 20:52:28 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:29 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 1G" returned: 0 in 0.674s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:29 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 Sep 05 20:52:29 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:29 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584" returned: 0 in 0.467s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:29 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 is being set with open permissions: ugo+rw Sep 05 20:52:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:29 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 Sep 05 20:52:29 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:30 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584" returned: 0 in 0.567s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.662s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-12b0681e-b4c2-4521-aaf9-5248e0318aa0 tempest-VolumesSnapshotListTestJSON-2094321514 None] Create snapshot completed successfully Sep 05 20:52:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-69acf522-fc8c-40de-90e4-e2dfd41eaa9d req-8c6acd23-974e-4a2c-ae72-594b3407bb8c tempest-AttachVolumeNegativeTest-1548556985 None] Terminate volume connection completed successfully. Sep 05 20:52:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-69acf522-fc8c-40de-90e4-e2dfd41eaa9d req-8c6acd23-974e-4a2c-ae72-594b3407bb8c tempest-AttachVolumeNegativeTest-1548556985 None] Deleting attachment 7fc29890-e325-44c5-8fc6-8de0c1344a04. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Creating offline snapshot 8ac69d46-6446-40c1-8528-1263cc90e66f of volume 675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb6708c-d549-421e-8727-c0a3c435d548]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:31 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 Sep 05 20:52:31 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:31 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584" returned: 0 in 0.590s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c5358-bba1-4d1f-ad50-43787f827453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:31 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f 1G Sep 05 20:52:31 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:32 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f 1G" returned: 0 in 0.849s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:32 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f Sep 05 20:52:32 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:33 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f" returned: 0 in 0.438s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:33 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f is being set with open permissions: ugo+rw Sep 05 20:52:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:33 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f Sep 05 20:52:33 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:33 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f" returned: 0 in 0.407s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:33 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7ab4d4a9-bd80-4775-8319-78fb9a8e28e9 tempest-VolumesSnapshotListTestJSON-2094321514 None] Create snapshot completed successfully Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-8ac69d46-6446-40c1-8528-1263cc90e66f-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-8ac69d46-6446-40c1-8528-1263cc90e66f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-quobyte-8ac69d46-6446-40c1-8528-1263cc90e66f" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-8ac69d46-6446-40c1-8528-1263cc90e66f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Deleting offline snapshot 8ac69d46-6446-40c1-8528-1263cc90e66f of volume 675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] snapshot_file for this snap is: volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a16c1-c129-485f-9361-eb7201b6e275]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:36 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f Sep 05 20:52:36 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:36 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f" returned: 0 in 0.465s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c5358-bba1-4d1f-ad50-43787f827453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:36 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f14a38-d5de-45ae-8130-c02c47699533]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:36 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 Sep 05 20:52:36 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:36 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584" returned: 0 in 0.533s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c5358-bba1-4d1f-ad50-43787f827453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:37 devstack sudo[92303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f Sep 05 20:52:37 devstack sudo[92303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:37 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-baccf7a1-feb2-481e-a01f-2acb437dfc06 tempest-GroupsV320Test-1869794908 None] Group tempest-GroupsV320Test-Group-231035403: creating Sep 05 20:52:37 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-baccf7a1-feb2-481e-a01f-2acb437dfc06 tempest-GroupsV320Test-1869794908 None] Group tempest-GroupsV320Test-Group-231035403: created successfully Sep 05 20:52:37 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-baccf7a1-feb2-481e-a01f-2acb437dfc06 tempest-GroupsV320Test-1869794908 None] Create group completed successfully. Sep 05 20:52:37 devstack sudo[92303]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f" returned: 0 in 0.714s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:37 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f Sep 05 20:52:37 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:38 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8ac69d46-6446-40c1-8528-1263cc90e66f" returned: 0 in 0.374s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-8ac69d46-6446-40c1-8528-1263cc90e66f" released by "_delete_snapshot" :: held 2.219s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" released by "delete_snapshot" :: held 2.251s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:38 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Created reservations ['cd1ef70f-2e17-480a-bae8-3685bd180099', 'e9732dab-7802-4c12-8385-b5bcb363c64f', '9c7047e9-eb4d-4926-ba1b-e3b2a157fa29', '388a7b51-2569-44a2-b526-d661ac0eb13c'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:38 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Delete snapshot completed successfully. Sep 05 20:52:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2f4dc7c-d595-47a0-9dcb-f0cbf2f9f2d5 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-8ac69d46-6446-40c1-8528-1263cc90e66f-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-8c7f4a88-7b82-4cd9-9163-1785ff376584-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-8c7f4a88-7b82-4cd9-9163-1785ff376584-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-quobyte-8c7f4a88-7b82-4cd9-9163-1785ff376584" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-8c7f4a88-7b82-4cd9-9163-1785ff376584" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Deleting offline snapshot 8c7f4a88-7b82-4cd9-9163-1785ff376584 of volume 675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] snapshot_file for this snap is: volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9364af7c-1132-4b73-b5bd-204ae60d9b27]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:39 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 Sep 05 20:52:39 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Created reservations ['52f3ac01-40dd-4326-a978-cc53dbfe75a3'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:39 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:52:39 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:39 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584" returned: 0 in 0.730s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c5358-bba1-4d1f-ad50-43787f827453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:40 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea72bff9-ba83-4ff6-811e-24b6c947dca1]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:40 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.362s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:40 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9cc6e41d-bf25-4967-869a-8794463df50c tempest-GroupsV320Test-1869794908 None] Delete group completed successfully. Sep 05 20:52:40 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 Sep 05 20:52:40 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:40 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024" returned: 0 in 0.513s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c5358-bba1-4d1f-ad50-43787f827453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:40 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 Sep 05 20:52:40 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:41 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584" returned: 0 in 0.547s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:41 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584 Sep 05 20:52:41 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:41 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.8c7f4a88-7b82-4cd9-9163-1785ff376584" returned: 0 in 0.330s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-8c7f4a88-7b82-4cd9-9163-1785ff376584" released by "_delete_snapshot" :: held 2.282s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" released by "delete_snapshot" :: held 2.318s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:41 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Created reservations ['cd3b9db1-8067-4600-83e2-722d0ec86a85', '930bef47-c404-4f2a-839f-a106ee57228a', 'bdaeb163-8b68-4122-820a-f359fc80c19a', 'bfdfa3f1-dd70-4ebc-bc03-754348d8cc01'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:41 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Delete snapshot completed successfully. Sep 05 20:52:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4f7e4e22-19e6-417a-a6e3-dce6ea6750a6 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-8c7f4a88-7b82-4cd9-9163-1785ff376584-delete_snapshot" released by "delete_snapshot" :: held 2.571s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-ef570ed7-7add-4ce8-9e36-f289b0b70024-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-ef570ed7-7add-4ce8-9e36-f289b0b70024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-quobyte-ef570ed7-7add-4ce8-9e36-f289b0b70024" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-ef570ed7-7add-4ce8-9e36-f289b0b70024" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Deleting offline snapshot ef570ed7-7add-4ce8-9e36-f289b0b70024 of volume 675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] snapshot_file for this snap is: volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[015bfef5-2861-4319-989a-8c33623f4eb2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:42 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 Sep 05 20:52:42 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Flow 'volume_create_manager' (fa1884b8-6e22-4465-b084-1990f5283531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cf34ce-ada4-4ffc-9a2d-9423e25be8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64cf34ce-ada4-4ffc-9a2d-9423e25be8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-848650357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a39f9952004ef0ab93205f400619e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:43Z,use_quota=True,user_id='262e4523b984498c8d005d01d42eaa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfb5ca1-c95c-4ac6-9fe7-6f3899588df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfb5ca1-c95c-4ac6-9fe7-6f3899588df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b60587-def2-494a-9436-8f848e7738cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b60587-def2-494a-9436-8f848e7738cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb', 'volume_name': 'volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87dffa6-0c4e-48c9-a62d-fdc1a9ff1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87dffa6-0c4e-48c9-a62d-fdc1a9ff1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ac7833-afe6-4c45-9160-5a0e5ea080d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:43 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Volume 9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb', 'volume_size': 1} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-848650357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a39f9952004ef0ab93205f400619e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:43Z,use_quota=True,user_id='262e4523b984498c8d005d01d42eaa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Creating volume 9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:52:43 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:43 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024" returned: 0 in 0.811s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c5358-bba1-4d1f-ad50-43787f827453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:52:43 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb 1073741824 Sep 05 20:52:43 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e548952d-4188-4cf7-b652-1080269f3c07]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:43 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 Sep 05 20:52:43 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:44 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453" returned: 0 in 0.694s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:44 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 Sep 05 20:52:44 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:44 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb 1073741824" returned: 0 in 0.983s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:44 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb Sep 05 20:52:44 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:44 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:44 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb" returned: 0 in 0.605s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024" returned: 0 in 0.888s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ac7833-afe6-4c45-9160-5a0e5ea080d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5225adad-a6a3-4e5e-871a-ec03d64799c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:45 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024 Sep 05 20:52:45 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:45 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Volume volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb (9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb): created successfully Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5225adad-a6a3-4e5e-871a-ec03d64799c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Flow 'volume_create_manager' (fa1884b8-6e22-4465-b084-1990f5283531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8683682f-e17c-4706-a82e-ed3dd3ac034e tempest-ServerActionsTestOtherA-1498271619 None] Created volume successfully. Sep 05 20:52:45 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453.ef570ed7-7add-4ce8-9e36-f289b0b70024" returned: 0 in 0.426s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-ef570ed7-7add-4ce8-9e36-f289b0b70024" released by "_delete_snapshot" :: held 3.000s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" released by "delete_snapshot" :: held 3.041s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Created reservations ['aa0bb1fb-db45-4b72-a740-295250c10d4d', '9754ad10-08fd-413b-91dc-7f153f5e3c83', 'fcfa1834-462c-4782-9ee2-0bf16d09fb75', '15b43cf1-a778-4632-b52a-25a29ddb1923'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Delete snapshot completed successfully. Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a18a1ece-e178-440d-b23b-12043e2fb35f tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-ef570ed7-7add-4ce8-9e36-f289b0b70024-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-675c5358-bba1-4d1f-ad50-43787f827453-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-675c5358-bba1-4d1f-ad50-43787f827453-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:46 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985b67c-625b-4f7e-8536-34b3d8059c0c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:46 devstack sudo[92383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 Sep 05 20:52:46 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:46 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453" returned: 0 in 0.594s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:46 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453 Sep 05 20:52:46 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:47 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-675c5358-bba1-4d1f-ad50-43787f827453" returned: 0 in 0.459s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-quobyte-675c5358-bba1-4d1f-ad50-43787f827453" released by "delete_volume" :: held 1.184s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Created reservations ['9b4d6b7e-a7f4-49e7-9587-014caf2296eb', '7590ec93-1312-4d91-9f50-1d37da12f650', '96c34434-abc1-4b57-8460-7c7b8b7defa7', '104b62ed-8681-40ec-bab8-c5893037b859'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:47 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:52:47 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:47 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Deleted volume successfully. Sep 05 20:52:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6fdaf30a-4e31-4723-892e-8adf49215300 tempest-VolumesSnapshotListTestJSON-2094321514 None] Lock "cinder-675c5358-bba1-4d1f-ad50-43787f827453-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=82,cinder:UPDATE=89,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=79,cinder:UPDATE=70,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Flow 'volume_create_manager' (4fe7bafd-0a34-4823-a38a-f575b4409e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f5d3d8-f0d0-4a81-a482-edd0be447646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f5d3d8-f0d0-4a81-a482-edd0be447646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1971315485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4e07ea-50e2-42fd-a4f7-36890c02d4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f05ace6c6f4d4ebdb9b131b6340e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:52Z,use_quota=True,user_id='86087ee255b4489fba461e4114b8c2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432e37e9-de97-4d81-8fc9-bcc7879adef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432e37e9-de97-4d81-8fc9-bcc7879adef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0778a1da-d16d-42d7-bc5e-7865ef5ea5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0778a1da-d16d-42d7-bc5e-7865ef5ea5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b4e07ea-50e2-42fd-a4f7-36890c02d4b5', 'volume_name': 'volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241a9131-b781-47dd-88f8-53d7cc7630b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241a9131-b781-47dd-88f8-53d7cc7630b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5304568-f295-473b-9452-f0c891731be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:52 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Volume 6b4e07ea-50e2-42fd-a4f7-36890c02d4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5', 'volume_size': 1} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1971315485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4e07ea-50e2-42fd-a4f7-36890c02d4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f05ace6c6f4d4ebdb9b131b6340e89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:52:52Z,use_quota=True,user_id='86087ee255b4489fba461e4114b8c2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Creating volume 6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:52:52 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:52:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:52 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 1073741824 Sep 05 20:52:52 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:53 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 1073741824" returned: 0 in 0.892s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:53 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 Sep 05 20:52:53 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:53 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5304568-f295-473b-9452-f0c891731be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489a4c16-716d-4ded-9a9c-e6db4be6ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:52:53 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Volume volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 (6b4e07ea-50e2-42fd-a4f7-36890c02d4b5): created successfully Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489a4c16-716d-4ded-9a9c-e6db4be6ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:52:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Flow 'volume_create_manager' (4fe7bafd-0a34-4823-a38a-f575b4409e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:52:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-84e10cc9-20d3-46f5-80cc-06cb21a99d24 tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Created volume successfully. Sep 05 20:52:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Acquiring lock "cinder-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "cinder-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Acquiring lock "cinder-quobyte-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:52:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "cinder-quobyte-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5" acquired by "delete_volume" :: waited 0.069s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:52:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef773e20-a7bc-478b-a743-2f3b3e9e2502]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:52:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:57 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 Sep 05 20:52:57 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:57 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5" returned: 0 in 0.788s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:57 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5 Sep 05 20:52:57 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:58 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5" returned: 0 in 0.526s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "cinder-quobyte-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5" released by "delete_volume" :: held 1.414s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Created reservations ['cc10f5c9-fe9a-47b8-b5f2-4bf93c86bc25', '73213883-b706-4926-95e9-42ba2914db18', '044df2e6-66ac-4ef7-a96f-ea08dff6b8ef', 'd29ca6b0-1c77-40a3-984e-d39d6b368c8e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:52:58 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:52:58 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:52:58 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.539s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:52:58 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:52:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Deleted volume successfully. Sep 05 20:52:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-36f6b383-b07b-458a-8a2e-0c91e504c6be tempest-VolumeQuotasNegativeTestJSON-1601107460 None] Lock "cinder-6b4e07ea-50e2-42fd-a4f7-36890c02d4b5-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:53:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:04 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:53:04 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:05 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.434s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:53:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:53:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:53:08 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:53:08 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Flow 'volume_create_manager' (8b77c2b1-98a0-4d51-97a3-559ea2ec723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50772462-2ff0-46c9-bb2e-67dd7989f796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50772462-2ff0-46c9-bb2e-67dd7989f796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-795545382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f18335e-870b-4165-b4e2-ce2491cd54ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6ee9207c4144bba7889a660ad7e6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:17Z,use_quota=True,user_id='c43ecf2ffc26490ba6625a783137c64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7721d9-cb39-4427-8a89-3cf253448c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7721d9-cb39-4427-8a89-3cf253448c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ba0e3e-02a3-4aa3-b03a-57f262808062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ba0e3e-02a3-4aa3-b03a-57f262808062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f18335e-870b-4165-b4e2-ce2491cd54ab', 'volume_name': 'volume-3f18335e-870b-4165-b4e2-ce2491cd54ab', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af4e5e1-4380-44a4-ab42-1659ce35c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af4e5e1-4380-44a4-ab42-1659ce35c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7727b978-1361-4eb1-8e6c-0b75e9c304c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Volume 3f18335e-870b-4165-b4e2-ce2491cd54ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f18335e-870b-4165-b4e2-ce2491cd54ab', 'volume_size': 1} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-795545382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f18335e-870b-4165-b4e2-ce2491cd54ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f6ee9207c4144bba7889a660ad7e6bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:17Z,use_quota=True,user_id='c43ecf2ffc26490ba6625a783137c64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Creating volume 3f18335e-870b-4165-b4e2-ce2491cd54ab {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:53:17 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:17 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab 1073741824 Sep 05 20:53:17 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:17 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab 1073741824" returned: 0 in 0.514s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:17 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab Sep 05 20:53:17 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:17 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab" returned: 0 in 0.296s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7727b978-1361-4eb1-8e6c-0b75e9c304c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f18335e-870b-4165-b4e2-ce2491cd54ab', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f1d706-559c-467d-aa53-c6c1f486918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Volume volume-3f18335e-870b-4165-b4e2-ce2491cd54ab (3f18335e-870b-4165-b4e2-ce2491cd54ab): created successfully Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f1d706-559c-467d-aa53-c6c1f486918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Flow 'volume_create_manager' (8b77c2b1-98a0-4d51-97a3-559ea2ec723b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9d15232b-655b-4383-9aff-7ad1e879ed70 tempest-VolumesServicesTestJSON-678934292 None] Created volume successfully. Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Acquiring lock "cinder-3f18335e-870b-4165-b4e2-ce2491cd54ab-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Lock "cinder-3f18335e-870b-4165-b4e2-ce2491cd54ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Acquiring lock "cinder-quobyte-3f18335e-870b-4165-b4e2-ce2491cd54ab" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Lock "cinder-quobyte-3f18335e-870b-4165-b4e2-ce2491cd54ab" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81d5b53-46ca-459d-9798-6ebb556d68b4]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:19 devstack sudo[92652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab Sep 05 20:53:19 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:19 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab" returned: 0 in 0.400s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:19 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab Sep 05 20:53:19 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:19 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f18335e-870b-4165-b4e2-ce2491cd54ab" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Lock "cinder-quobyte-3f18335e-870b-4165-b4e2-ce2491cd54ab" released by "delete_volume" :: held 0.695s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:19 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Created reservations ['3175806f-d8c3-4c92-843b-102d006b0da8', '0b8feaec-178f-410a-b920-659b0d83371b', 'be71ebaf-d655-4ed6-8ef6-74788816e7e0', '62b3d2d9-b7c4-440e-b2f1-e8ba488cd6b9'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:20 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:53:20 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:20 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.420s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Deleted volume successfully. Sep 05 20:53:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-14b10795-df12-492f-9ccf-8e0607979aeb tempest-VolumesServicesTestJSON-678934292 None] Lock "cinder-3f18335e-870b-4165-b4e2-ce2491cd54ab-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Flow 'volume_create_manager' (7eaa9408-f074-4342-83af-eb248df46efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8a8149-8162-4812-b1b0-02a2cfc25fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b8a8149-8162-4812-b1b0-02a2cfc25fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-673534913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7638df2e-5ca0-4c0a-af57-2d4ab114faf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a79580e821422b850a2db9bf03b51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:22Z,use_quota=True,user_id='e4c16e728c0f4a98bd907f5d57fb2ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d239f3d-582b-434d-959b-0ca6b68de299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d239f3d-582b-434d-959b-0ca6b68de299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06acfab9-d3a6-4bb0-ad00-012174c6be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06acfab9-d3a6-4bb0-ad00-012174c6be0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7638df2e-5ca0-4c0a-af57-2d4ab114faf4', 'volume_name': 'volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eaceab-885b-44de-ad76-581ec6e5f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eaceab-885b-44de-ad76-581ec6e5f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8534fc7-e295-4860-9110-0ff0b2819009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:21 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Volume 7638df2e-5ca0-4c0a-af57-2d4ab114faf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4', 'volume_size': 1} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-673534913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7638df2e-5ca0-4c0a-af57-2d4ab114faf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a79580e821422b850a2db9bf03b51b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:22Z,use_quota=True,user_id='e4c16e728c0f4a98bd907f5d57fb2ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Creating volume 7638df2e-5ca0-4c0a-af57-2d4ab114faf4 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:53:21 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:53:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:21 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 1073741824 Sep 05 20:53:21 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:22 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 1073741824" returned: 0 in 0.704s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:22 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 Sep 05 20:53:22 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:22 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4" returned: 0 in 0.309s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:53:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8534fc7-e295-4860-9110-0ff0b2819009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d96ee5e-dd65-470b-a0f7-856f9fd26c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:23 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Volume volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 (7638df2e-5ca0-4c0a-af57-2d4ab114faf4): created successfully Sep 05 20:53:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d96ee5e-dd65-470b-a0f7-856f9fd26c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Flow 'volume_create_manager' (7eaa9408-f074-4342-83af-eb248df46efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e9278668-eb75-4510-b345-18b9f3b06c9a tempest-AttachVolumeNegativeTest-1548556985 None] Created volume successfully. Sep 05 20:53:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-62b73956-c03e-4a59-8200-9bf555554e87 req-1a978906-3a62-48de-95fb-41026a65b801 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-62b73956-c03e-4a59-8200-9bf555554e87 req-1a978906-3a62-48de-95fb-41026a65b801 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-62b73956-c03e-4a59-8200-9bf555554e87 req-1a978906-3a62-48de-95fb-41026a65b801 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-62b73956-c03e-4a59-8200-9bf555554e87 req-1a978906-3a62-48de-95fb-41026a65b801 tempest-AttachVolumeNegativeTest-1548556985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a43d7298-acfd-4fa3-a42d-32110c9238bb', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:53:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-582b9a3d-b4d0-4f68-9913-44f1a4c7e3b0 req-1ba6d2f6-3397-4255-9ceb-12cfaade9337 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-582b9a3d-b4d0-4f68-9913-44f1a4c7e3b0 req-1ba6d2f6-3397-4255-9ceb-12cfaade9337 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-62b73956-c03e-4a59-8200-9bf555554e87 req-1a978906-3a62-48de-95fb-41026a65b801 tempest-AttachVolumeNegativeTest-1548556985 None] attachment_update completed successfully. Sep 05 20:53:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-582b9a3d-b4d0-4f68-9913-44f1a4c7e3b0 req-1ba6d2f6-3397-4255-9ceb-12cfaade9337 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-582b9a3d-b4d0-4f68-9913-44f1a4c7e3b0 req-1ba6d2f6-3397-4255-9ceb-12cfaade9337 tempest-ServerActionsTestOtherA-1498271619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a6548f4-e6da-4894-91de-500cf13acf4f', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:53:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-582b9a3d-b4d0-4f68-9913-44f1a4c7e3b0 req-1ba6d2f6-3397-4255-9ceb-12cfaade9337 tempest-ServerActionsTestOtherA-1498271619 None] attachment_update completed successfully. Sep 05 20:53:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-3d57113b-46c7-4f94-b459-b4bd480b81af req-eb54fd5f-04dd-4142-813b-2378a52d62e8 tempest-AttachVolumeNegativeTest-1548556985 None] Terminate volume connection completed successfully. Sep 05 20:53:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-3d57113b-46c7-4f94-b459-b4bd480b81af req-eb54fd5f-04dd-4142-813b-2378a52d62e8 tempest-AttachVolumeNegativeTest-1548556985 None] Deleting attachment a43d7298-acfd-4fa3-a42d-32110c9238bb. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Flow 'volume_create_manager' (aa0c6585-e5fa-435f-8929-ee2cacafb1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cff621-8acd-4d7a-9a48-142eff2ccbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cff621-8acd-4d7a-9a48-142eff2ccbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1820329162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ee7677-f610-4064-a7ec-56dc060bd45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223007fe49c042e786d9da81c0ae91ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:30Z,use_quota=True,user_id='ff2e8aa401a44b02b2dec6c7288b39d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad68cbc5-3c6d-4e19-b10a-85babddca699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad68cbc5-3c6d-4e19-b10a-85babddca699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc214a8-d2c8-4572-86c9-2dfb37921d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc214a8-d2c8-4572-86c9-2dfb37921d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ee7677-f610-4064-a7ec-56dc060bd45a', 'volume_name': 'volume-e7ee7677-f610-4064-a7ec-56dc060bd45a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14b2e5-4289-40fe-9ef8-b0d72e462eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14b2e5-4289-40fe-9ef8-b0d72e462eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8ca0f0-576c-460d-9721-622336d2f23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:30 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Volume e7ee7677-f610-4064-a7ec-56dc060bd45a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ee7677-f610-4064-a7ec-56dc060bd45a', 'volume_size': 1} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1820329162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ee7677-f610-4064-a7ec-56dc060bd45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='223007fe49c042e786d9da81c0ae91ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:30Z,use_quota=True,user_id='ff2e8aa401a44b02b2dec6c7288b39d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Creating volume e7ee7677-f610-4064-a7ec-56dc060bd45a {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:53:30 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:30 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a 1073741824 Sep 05 20:53:30 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-c24d29fd-1c8f-4f51-a26b-56b1746d23b2 req-c0307ec0-645a-4082-b65d-bc58e19c8c95 tempest-ServerActionsTestOtherA-1498271619 None] Terminate volume connection completed successfully. Sep 05 20:53:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-c24d29fd-1c8f-4f51-a26b-56b1746d23b2 req-c0307ec0-645a-4082-b65d-bc58e19c8c95 tempest-ServerActionsTestOtherA-1498271619 None] Deleting attachment 4a6548f4-e6da-4894-91de-500cf13acf4f. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:53:31 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a 1073741824" returned: 0 in 0.897s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:31 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a Sep 05 20:53:31 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:32 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a" returned: 0 in 0.520s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8ca0f0-576c-460d-9721-622336d2f23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ee7677-f610-4064-a7ec-56dc060bd45a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c03fb5d-fb64-4deb-9462-7385c58bec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Volume volume-e7ee7677-f610-4064-a7ec-56dc060bd45a (e7ee7677-f610-4064-a7ec-56dc060bd45a): created successfully Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c03fb5d-fb64-4deb-9462-7385c58bec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Flow 'volume_create_manager' (aa0c6585-e5fa-435f-8929-ee2cacafb1bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-92c54736-e8fe-4cf6-8e66-df3ff23bae55 tempest-TestImageHashVerification-143671751 None] Created volume successfully. Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-c24d29fd-1c8f-4f51-a26b-56b1746d23b2 req-73e64d23-2a00-4c1d-9938-6e8220f82280 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-c24d29fd-1c8f-4f51-a26b-56b1746d23b2 req-73e64d23-2a00-4c1d-9938-6e8220f82280 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-c24d29fd-1c8f-4f51-a26b-56b1746d23b2 req-73e64d23-2a00-4c1d-9938-6e8220f82280 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-c24d29fd-1c8f-4f51-a26b-56b1746d23b2 req-73e64d23-2a00-4c1d-9938-6e8220f82280 tempest-ServerActionsTestOtherA-1498271619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5ae9571-139b-44b3-91ef-442816a4115e', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:53:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-c24d29fd-1c8f-4f51-a26b-56b1746d23b2 req-73e64d23-2a00-4c1d-9938-6e8220f82280 tempest-ServerActionsTestOtherA-1498271619 None] attachment_update completed successfully. Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Flow 'volume_create_manager' (de2c233d-8024-482d-9bac-a2d915c27ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38ce55-1798-4fcc-944f-2210498d333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb38ce55-1798-4fcc-944f-2210498d333f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2012624810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26db853f-fc17-4d2b-a4e3-d98d7742c2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d55cd0e9bf84bfb9056ca011716e178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:33Z,use_quota=True,user_id='14d12903cd184537ad1f191e86fcda0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a73e06-074d-48ff-9366-bcfc35eaccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a73e06-074d-48ff-9366-bcfc35eaccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5f3131-cdf0-463f-a075-4a97f56d3b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5f3131-cdf0-463f-a075-4a97f56d3b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26db853f-fc17-4d2b-a4e3-d98d7742c2ab', 'volume_name': 'volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7155ee-5c2d-476e-b148-977defc3fe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af7155ee-5c2d-476e-b148-977defc3fe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1eb4a0-508d-430d-a218-b6c5fd9f6f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Volume 26db853f-fc17-4d2b-a4e3-d98d7742c2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab', 'volume_size': 1} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2012624810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26db853f-fc17-4d2b-a4e3-d98d7742c2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d55cd0e9bf84bfb9056ca011716e178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:53:33Z,use_quota=True,user_id='14d12903cd184537ad1f191e86fcda0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Creating volume 26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:53:33 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:33 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab 1073741824 Sep 05 20:53:33 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:33 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab 1073741824" returned: 0 in 0.677s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:33 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab Sep 05 20:53:33 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:34 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" returned: 0 in 0.398s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f1eb4a0-508d-430d-a218-b6c5fd9f6f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab63686-dda0-480a-ac2f-5e9ab33d07df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Volume volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab (26db853f-fc17-4d2b-a4e3-d98d7742c2ab): created successfully Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab63686-dda0-480a-ac2f-5e9ab33d07df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Flow 'volume_create_manager' (de2c233d-8024-482d-9bac-a2d915c27ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-82adc93b-03dd-46e6-9bda-be6e0620a362 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Created volume successfully. Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f32baa-a2a8-4c5a-a34a-ffcb18608c8c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:34 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a Sep 05 20:53:34 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:35 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a" returned: 0 in 0.853s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:35 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[321964cc-0d6a-4948-978c-a5e2ba334489]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:35 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a Sep 05 20:53:35 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:35 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a" returned: 0 in 0.612s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a /opt/stack/data/cinder/conversion/e7ee7677-f610-4064-a7ec-56dc060bd45a.temp_image.9c50aa3b-0e53-40fd-93b2-7c586660c03cb8f_k_lf.img {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:35 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a /opt/stack/data/cinder/conversion/e7ee7677-f610-4064-a7ec-56dc060bd45a.temp_image.9c50aa3b-0e53-40fd-93b2-7c586660c03cb8f_k_lf.img Sep 05 20:53:35 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "cinder-7638df2e-5ca0-4c0a-af57-2d4ab114faf4-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-7638df2e-5ca0-4c0a-af57-2d4ab114faf4-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "cinder-quobyte-7638df2e-5ca0-4c0a-af57-2d4ab114faf4" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-quobyte-7638df2e-5ca0-4c0a-af57-2d4ab114faf4" acquired by "delete_volume" :: waited 0.057s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:40 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f167a451-8c8c-42a5-836b-837ddead86ed]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:41 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 Sep 05 20:53:41 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:41 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4" returned: 0 in 1.138s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:42 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4 Sep 05 20:53:42 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:42 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7638df2e-5ca0-4c0a-af57-2d4ab114faf4" returned: 0 in 0.981s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-quobyte-7638df2e-5ca0-4c0a-af57-2d4ab114faf4" released by "delete_volume" :: held 2.277s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Created reservations ['689df43f-2c64-422f-96ac-bbf92e0193ac', '3e501445-26a4-4295-b78a-aa38b00bb2aa', '886d3a5c-46d6-4f58-ae05-41516a9975ce', 'a3264ee6-5ddb-4cc1-8f55-61d8adccf94b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:43 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a /opt/stack/data/cinder/conversion/e7ee7677-f610-4064-a7ec-56dc060bd45a.temp_image.9c50aa3b-0e53-40fd-93b2-7c586660c03cb8f_k_lf.img" returned: 0 in 7.477s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[07891bdb-92ae-47cb-b968-4720364ff63e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:43 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:53:43 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:43 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a Sep 05 20:53:43 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:43 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.369s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Deleted volume successfully. Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d761e75f-8efb-4cfe-afd4-433d256a3ce0 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-7638df2e-5ca0-4c0a-af57-2d4ab114faf4-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:43 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a" returned: 0 in 0.549s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:43 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/conversion/e7ee7677-f610-4064-a7ec-56dc060bd45a.temp_image.9c50aa3b-0e53-40fd-93b2-7c586660c03cb8f_k_lf.img {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:53:43 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Converted 1024.00 MB image at 136.89 MB/s Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] 9c50aa3b-0e53-40fd-93b2-7c586660c03c was raw, no need to convert to raw {{(pid=87778) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "cinder-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "cinder-quobyte-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-quobyte-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847b802-5c58-4d4d-a3e8-0d707dbeb948]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:44 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc Sep 05 20:53:44 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:44 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc" returned: 0 in 0.438s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:44 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc Sep 05 20:53:44 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:45 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc" returned: 0 in 0.260s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-quobyte-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc" released by "delete_volume" :: held 0.764s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Created reservations ['2de48539-f6a3-4ebc-8494-2ce016fd00d0', '5ce742ec-a508-4914-bb94-6a903d7df63c', '21dd860f-f178-48ad-a8ef-adf1d172ef2f', 'df1df999-1544-4221-b6a0-8872fb2c8a38'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:45 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:53:45 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:45 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Deleted volume successfully. Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b0a4fe5-798e-46dc-a53b-44741852ad07 tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-bfad7f08-5b0d-4fe0-9efd-41b203f2b3dc-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "cinder-195b2106-41ef-4468-8e45-26ee43a10df8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-195b2106-41ef-4468-8e45-26ee43a10df8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "cinder-quobyte-195b2106-41ef-4468-8e45-26ee43a10df8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-quobyte-195b2106-41ef-4468-8e45-26ee43a10df8" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b4d02d-a054-4e67-8751-a6c711705620]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:53:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:45 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 Sep 05 20:53:45 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:46 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8" returned: 0 in 0.428s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:46 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8 Sep 05 20:53:46 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:46 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-195b2106-41ef-4468-8e45-26ee43a10df8" returned: 0 in 0.456s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-quobyte-195b2106-41ef-4468-8e45-26ee43a10df8" released by "delete_volume" :: held 0.944s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Created reservations ['4fff181f-4f53-4a5c-9611-9639c4ee50d9', '32e0b275-c7a4-4e54-925b-814b268373de', 'f22f514f-fa9f-427e-8fb1-eb30390a8963', 'e26ae1b4-cda5-4ab6-a9a3-f16845f1330e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:53:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:53:47 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:53:47 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:53:47 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 05 20:53:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.329s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:53:47 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:53:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Deleted volume successfully. Sep 05 20:53:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-34528071-c66c-4424-adc4-3679d7c34bbf tempest-AttachVolumeNegativeTest-1548556985 None] Lock "cinder-195b2106-41ef-4468-8e45-26ee43a10df8-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:53:56 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=57,cinder:UPDATE=46,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:53:57 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=53,cinder:SELECT=47,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Flow 'volume_create_manager' (5f460f55-e65b-4350-ad47-e02d130ed797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7d0e56-cd1d-41f9-a8fc-d1b8c0446cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7d0e56-cd1d-41f9-a8fc-d1b8c0446cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1618328344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c789ec-c0f8-4556-a01b-5f60a69981f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6e963a19dc42929cfa4484f519ac80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:00Z,use_quota=True,user_id='e57eb0efaf074ac68d9a907898e42a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50a0223-c6fb-4667-ae6e-59183da42ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50a0223-c6fb-4667-ae6e-59183da42ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4650e5-08b8-4b8b-be17-492fc64beed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4650e5-08b8-4b8b-be17-492fc64beed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c789ec-c0f8-4556-a01b-5f60a69981f8', 'volume_name': 'volume-83c789ec-c0f8-4556-a01b-5f60a69981f8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3706a8b-4316-4bad-ad2d-536a382971a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3706a8b-4316-4bad-ad2d-536a382971a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827dc6aa-728d-4acc-8891-807bc6c3f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:53:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Volume 83c789ec-c0f8-4556-a01b-5f60a69981f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c789ec-c0f8-4556-a01b-5f60a69981f8', 'volume_size': 1} Sep 05 20:53:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-67c2287b-3c74-4c47-a2a3-ce90fcfe47cf req-6b0b0f9e-59c3-4d67-87d8-feac51ae36e9 tempest-ServerActionsTestOtherA-1498271619 None] Terminate volume connection completed successfully. Sep 05 20:54:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-67c2287b-3c74-4c47-a2a3-ce90fcfe47cf req-6b0b0f9e-59c3-4d67-87d8-feac51ae36e9 tempest-ServerActionsTestOtherA-1498271619 None] Deleting attachment e5ae9571-139b-44b3-91ef-442816a4115e. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:54:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:54:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:04 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:54:04 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:05 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.625s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:54:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:54:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:54:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.406s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Uploaded volume to glance image-id: 9c50aa3b-0e53-40fd-93b2-7c586660c03c. {{(pid=87778) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 20:54:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 32.207s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Creating offline snapshot 23f149a4-f927-40a8-8a3d-e5d4e96517b9 of volume 26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:54:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c415448d-66cf-4fbe-9a45-b68a216e1e49 tempest-TestImageHashVerification-143671751 None] Copy volume to image completed successfully. Sep 05 20:54:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[064efd28-990f-4323-8105-ff082a35e586]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:07 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab Sep 05 20:54:07 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:08 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:08 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 1G Sep 05 20:54:08 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:08 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 1G" returned: 0 in 0.516s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:08 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 Sep 05 20:54:08 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:09 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9" returned: 0 in 0.384s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:09 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 is being set with open permissions: ugo+rw Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:09 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 Sep 05 20:54:09 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:09 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9" returned: 0 in 0.319s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Acquiring lock "cinder-e7ee7677-f610-4064-a7ec-56dc060bd45a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Lock "cinder-e7ee7677-f610-4064-a7ec-56dc060bd45a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:09 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.info Sep 05 20:54:09 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Acquiring lock "cinder-quobyte-e7ee7677-f610-4064-a7ec-56dc060bd45a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Lock "cinder-quobyte-e7ee7677-f610-4064-a7ec-56dc060bd45a" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddcb32f-544b-476c-8036-031dceefd593]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:09 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a Sep 05 20:54:09 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:09 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.info" returned: 0 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:09 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.info is being set with open permissions: ugo+rw Sep 05 20:54:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:09 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.info Sep 05 20:54:09 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:10 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a" returned: 0 in 0.478s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:10 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.info" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:10 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a Sep 05 20:54:10 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.573s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1618328344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c789ec-c0f8-4556-a01b-5f60a69981f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6e963a19dc42929cfa4484f519ac80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:00Z,use_quota=True,user_id='e57eb0efaf074ac68d9a907898e42a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Creating volume 83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:10 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:10 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 1073741824 Sep 05 20:54:10 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:10 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1d5258ed-0195-4055-9b71-337703b609b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Create snapshot completed successfully Sep 05 20:54:10 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e7ee7677-f610-4064-a7ec-56dc060bd45a" returned: 0 in 0.375s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Flow 'volume_create_manager' (7fc302da-16b7-45f8-9279-2699fa2d3942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff98fc57-4c96-44c9-af05-7f11865ee297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Lock "cinder-quobyte-e7ee7677-f610-4064-a7ec-56dc060bd45a" released by "delete_volume" :: held 0.950s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff98fc57-4c96-44c9-af05-7f11865ee297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-905977341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7082c12d-f854-49bc-b2e6-5337872ad70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a39f9952004ef0ab93205f400619e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:11Z,use_quota=True,user_id='262e4523b984498c8d005d01d42eaa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1305b41-cf33-4710-a367-760922eaa386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1305b41-cf33-4710-a367-760922eaa386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a42183-bfce-4509-812d-b815de8d54a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Created reservations ['4bb20709-d408-4706-b4c2-88acae8a999e', '9e914ac6-0003-4b72-8654-378480405e5b', 'c671c480-51d7-42ed-a185-7f498b0df1e1', '8a88cc9c-648d-4e89-8f73-0ae9bc638df3'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:10 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:54:10 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:10 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 1073741824" returned: 0 in 0.667s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:11 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 Sep 05 20:54:11 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:11 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.382s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a42183-bfce-4509-812d-b815de8d54a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7082c12d-f854-49bc-b2e6-5337872ad70a', 'volume_name': 'volume-7082c12d-f854-49bc-b2e6-5337872ad70a', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77c577e-1490-44d1-99a2-065711862aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77c577e-1490-44d1-99a2-065711862aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ad5fc8-3eb1-4523-bbe4-9300840b46ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Volume 7082c12d-f854-49bc-b2e6-5337872ad70a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7082c12d-f854-49bc-b2e6-5337872ad70a', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Trying to clone 7082c12d-f854-49bc-b2e6-5337872ad70a from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 20:54:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Deleted volume successfully. Sep 05 20:54:11 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d67d51f8-2ca9-4b3e-8909-9e95c6fc0050 tempest-TestImageHashVerification-143671751 None] Lock "cinder-e7ee7677-f610-4064-a7ec-56dc060bd45a-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8" returned: 0 in 0.358s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827dc6aa-728d-4acc-8891-807bc6c3f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c789ec-c0f8-4556-a01b-5f60a69981f8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfea5955-7f5a-4642-b853-d391f7cc223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Volume volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 (83c789ec-c0f8-4556-a01b-5f60a69981f8): created successfully Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfea5955-7f5a-4642-b853-d391f7cc223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Flow 'volume_create_manager' (5f460f55-e65b-4350-ad47-e02d130ed797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-7a7880fb-7ab5-4bf6-973f-58613f5eebbd req-93401a7c-fe9f-4dd1-9f3d-c2be7539c123 tempest-VolumesSnapshotsTestJSON-504191748 None] Created volume successfully. Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "cinder-23f149a4-f927-40a8-8a3d-e5d4e96517b9-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-23f149a4-f927-40a8-8a3d-e5d4e96517b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "cinder-quobyte-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-quobyte-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "cinder-quobyte-23f149a4-f927-40a8-8a3d-e5d4e96517b9" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-quobyte-23f149a4-f927-40a8-8a3d-e5d4e96517b9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Deleting offline snapshot 23f149a4-f927-40a8-8a3d-e5d4e96517b9 of volume 26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] snapshot_file for this snap is: volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb1ca70-22e7-459d-98bb-0861512883ea]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 20:54:11 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Image download 20.69 MB at 20.69 MB/s Sep 05 20:54:11 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 Sep 05 20:54:11 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1959ab16-2b9b-47af-acc9-a2c255f6e242]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:12 devstack sudo[93927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD Sep 05 20:54:12 devstack sudo[93927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:12 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9" returned: 0 in 0.485s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b73f0-4375-4c06-8ed2-ab024e1972ec]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Creating offline snapshot 48fd7487-986b-4854-84c5-8ff2cd20757e of volume 83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:54:12 devstack sudo[93927]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 is fetched for user 262e4523b984498c8d005d01d42eaa3e. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b7957f-13c5-43cf-83a7-95c3b672bbb3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:12 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab Sep 05 20:54:12 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfccc96-89a3-4bbc-bd73-617e53c1198e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:12 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 Sep 05 20:54:12 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:12 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD Sep 05 20:54:12 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:12 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" returned: 0 in 0.607s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:12 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8" returned: 0 in 0.511s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:12 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 Sep 05 20:54:12 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:12 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e 1G Sep 05 20:54:12 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:12 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:13 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9" returned: 0 in 0.428s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:13 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9 Sep 05 20:54:13 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:13 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e 1G" returned: 0 in 0.515s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:13 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e Sep 05 20:54:13 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:13 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab.23f149a4-f927-40a8-8a3d-e5d4e96517b9" returned: 0 in 0.356s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-quobyte-23f149a4-f927-40a8-8a3d-e5d4e96517b9" released by "_delete_snapshot" :: held 2.060s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-quobyte-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" released by "delete_snapshot" :: held 2.104s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Created reservations ['e34528f0-23b3-4603-9e22-b77015dd8276', '7868e27b-0cfd-446e-b957-bb93c3a1aa1d', 'de1d3894-0e6f-4092-af81-5af46406d813', 'fb9e5216-dd26-4c9a-b2d3-5d1c3ca50d64'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:13 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e" returned: 0 in 0.503s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:13 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e is being set with open permissions: ugo+rw Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:13 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e Sep 05 20:54:13 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Delete snapshot completed successfully. Sep 05 20:54:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-829de020-9ad4-4ff3-83c7-74b40ef33d8d tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-23f149a4-f927-40a8-8a3d-e5d4e96517b9-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:14 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e" returned: 0 in 0.330s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:14 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.info Sep 05 20:54:14 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:14 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.info" returned: 0 in 0.309s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:14 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.info is being set with open permissions: ugo+rw Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:14 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.info Sep 05 20:54:14 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:14 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.info" returned: 0 in 0.336s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-905977341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7082c12d-f854-49bc-b2e6-5337872ad70a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a39f9952004ef0ab93205f400619e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:11Z,use_quota=True,user_id='262e4523b984498c8d005d01d42eaa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Creating volume 7082c12d-f854-49bc-b2e6-5337872ad70a {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:14 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "cinder-26db853f-fc17-4d2b-a4e3-d98d7742c2ab-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:14 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a 1073741824 Sep 05 20:54:14 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-26db853f-fc17-4d2b-a4e3-d98d7742c2ab-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-fde91846-dade-46d0-be79-00060a227c7d req-35379c0e-dc35-445e-8ffb-897b1089f775 tempest-VolumesSnapshotsTestJSON-504191748 None] Create snapshot completed successfully Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "cinder-quobyte-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-quobyte-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91463d1-ae5d-43fe-8cd3-2f37a6b283b1]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:15 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab Sep 05 20:54:15 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:15 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a 1073741824" returned: 0 in 0.586s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:15 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a Sep 05 20:54:15 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:15 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" returned: 0 in 0.484s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:15 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab Sep 05 20:54:15 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "cinder-48fd7487-986b-4854-84c5-8ff2cd20757e-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-48fd7487-986b-4854-84c5-8ff2cd20757e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "cinder-quobyte-83c789ec-c0f8-4556-a01b-5f60a69981f8" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-quobyte-83c789ec-c0f8-4556-a01b-5f60a69981f8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "cinder-quobyte-48fd7487-986b-4854-84c5-8ff2cd20757e" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-quobyte-48fd7487-986b-4854-84c5-8ff2cd20757e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Deleting offline snapshot 48fd7487-986b-4854-84c5-8ff2cd20757e of volume 83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:54:15 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] snapshot_file for this snap is: volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a" returned: 0 in 0.351s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c0245-5a39-4e64-ba2d-d95d0089c123]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:15 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" returned: 0 in 0.347s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-quobyte-26db853f-fc17-4d2b-a4e3-d98d7742c2ab" released by "delete_volume" :: held 0.907s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:15 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Attempting download of 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 7082c12d-f854-49bc-b2e6-5337872ad70a. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b0515f-5e3e-4217-bc63-d5dff16faafd]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_6mzdcdj4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Created reservations ['d8ddc5e6-d8d0-4c12-b0bd-1932225734c3', 'c319d296-6c3c-4f7f-ae4d-1c03d90d531c', 'be0a31eb-320c-422f-b89a-38c7202fb82b', 'c3afcee7-5f9f-4b9c-aa42-717a73722d0d'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:16 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e Sep 05 20:54:16 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:16 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_6mzdcdj4 Sep 05 20:54:16 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:16 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:54:16 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:16 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e" returned: 0 in 0.648s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83c789ec-c0f8-4556-a01b-5f60a69981f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:16 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad21ce1-b077-4eca-9654-8cc372be380c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_6mzdcdj4" returned: 0 in 0.606s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_6mzdcdj4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:16 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.509s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Deleted volume successfully. Sep 05 20:54:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-abc7566d-7b0e-4f8a-b149-0b49def87054 tempest-VolumeSnapshotQuotasNegativeTestJSON-280956385 None] Lock "cinder-26db853f-fc17-4d2b-a4e3-d98d7742c2ab-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:16 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 Sep 05 20:54:16 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:16 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_6mzdcdj4 Sep 05 20:54:16 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:17 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_6mzdcdj4" returned: 1 in 0.526s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_6mzdcdj4' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[07df85a9-de2e-43a4-950f-b866286deaeb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:17 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8" returned: 0 in 0.578s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:17 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e Sep 05 20:54:17 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:17 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD Sep 05 20:54:17 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:17 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] 1e185b14-4f13-44ff-ab1c-d13d5db83085 was qcow2, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:17 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a Sep 05 20:54:17 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:17 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e" returned: 0 in 0.561s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:17 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e Sep 05 20:54:17 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:18 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8.48fd7487-986b-4854-84c5-8ff2cd20757e" returned: 0 in 0.433s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-quobyte-48fd7487-986b-4854-84c5-8ff2cd20757e" released by "_delete_snapshot" :: held 2.418s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-quobyte-83c789ec-c0f8-4556-a01b-5f60a69981f8" released by "delete_snapshot" :: held 2.464s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:18 devstack cinder-volume[87778]: DEBUG cinder.quota [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Created reservations ['d913c72f-d774-40e9-a720-46dd8efe660a', 'f4348f23-0c09-46a7-a7c7-d1aaf5d66695', 'a9dbfc12-5335-4357-acd1-a8e65dc51a4a', '310f32e5-2834-4b0c-bee8-ae4309059d4d'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Delete snapshot completed successfully. Sep 05 20:54:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-ca239638-0691-406d-ba14-47ec52ce92d4 req-f3504188-eb0a-48bf-bf06-3c2f5e1c0982 tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-48fd7487-986b-4854-84c5-8ff2cd20757e-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "cinder-83c789ec-c0f8-4556-a01b-5f60a69981f8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-83c789ec-c0f8-4556-a01b-5f60a69981f8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "cinder-quobyte-83c789ec-c0f8-4556-a01b-5f60a69981f8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-quobyte-83c789ec-c0f8-4556-a01b-5f60a69981f8" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:19 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efe3c61-3d06-422f-bdcf-6fd3b7478544]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:19 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 Sep 05 20:54:19 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:20 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8" returned: 0 in 0.572s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:20 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8 Sep 05 20:54:20 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:20 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-83c789ec-c0f8-4556-a01b-5f60a69981f8" returned: 0 in 0.427s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-quobyte-83c789ec-c0f8-4556-a01b-5f60a69981f8" released by "delete_volume" :: held 1.135s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:20 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a" returned: 0 in 2.956s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_p96f9xu2devstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:54:20 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Converted 112.00 MB image at 37.75 MB/s Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:20 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a 1G Sep 05 20:54:20 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG cinder.quota [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Created reservations ['4b1f10cf-932e-45cd-8bf8-0bd706f32fcb', 'bb8c7ec0-81d0-4618-8ce9-e7bf39a2af52', 'fcb4cdb8-101f-4962-a94a-31ee766ad8ed', 'a0ee95d2-a94f-4599-95e7-9c321bcfe514'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:20 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:54:20 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:21 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a 1G" returned: 0 in 0.532s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Downloaded image 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 7082c12d-f854-49bc-b2e6-5337872ad70a successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 for user 262e4523b984498c8d005d01d42eaa3e is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Marking volume 7082c12d-f854-49bc-b2e6-5337872ad70a as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Copying metadata from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 to 7082c12d-f854-49bc-b2e6-5337872ad70a. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Creating volume glance metadata for volume 7082c12d-f854-49bc-b2e6-5337872ad70a backed by image 1e185b14-4f13-44ff-ab1c-d13d5db83085 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 20:54:21 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.423s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.manager [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Deleted volume successfully. Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-cbb5dbe1-f3d4-47dc-ad68-78d42ad7221c req-bba6d407-3a24-454d-b47c-9bf68ed74b3a tempest-VolumesSnapshotsTestJSON-504191748 None] Lock "cinder-83c789ec-c0f8-4556-a01b-5f60a69981f8-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ad5fc8-3eb1-4523-bbe4-9300840b46ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7082c12d-f854-49bc-b2e6-5337872ad70a', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140b4e5a-41ea-4485-9d75-2d763e7bc3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:21 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Volume volume-7082c12d-f854-49bc-b2e6-5337872ad70a (7082c12d-f854-49bc-b2e6-5337872ad70a): created successfully Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140b4e5a-41ea-4485-9d75-2d763e7bc3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Flow 'volume_create_manager' (7fc302da-16b7-45f8-9279-2699fa2d3942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ff65666f-f586-4558-9b20-13206d438ed1 tempest-ServerActionsTestOtherA-1498271619 None] Created volume successfully. Sep 05 20:54:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-446adc6a-caf3-40c8-bbfe-b128ce49489f req-89873c16-0dcc-4e74-9300-5a67867d4ba5 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-446adc6a-caf3-40c8-bbfe-b128ce49489f req-89873c16-0dcc-4e74-9300-5a67867d4ba5 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-446adc6a-caf3-40c8-bbfe-b128ce49489f req-89873c16-0dcc-4e74-9300-5a67867d4ba5 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-446adc6a-caf3-40c8-bbfe-b128ce49489f req-89873c16-0dcc-4e74-9300-5a67867d4ba5 tempest-ServerActionsTestOtherA-1498271619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-7082c12d-f854-49bc-b2e6-5337872ad70a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fc4f522-9536-41fc-9f98-b733545644cc', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:54:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-446adc6a-caf3-40c8-bbfe-b128ce49489f req-89873c16-0dcc-4e74-9300-5a67867d4ba5 tempest-ServerActionsTestOtherA-1498271619 None] attachment_update completed successfully. Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Flow 'volume_create_manager' (8a8034b0-bfd2-44c6-af54-3ba4c2c84384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381eb347-7733-4dd1-aa95-00a133a0ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381eb347-7733-4dd1-aa95-00a133a0ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1564394659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777eada0-ab87-410a-aea9-7c28525b6b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43591c642894c2284c17d732e62daeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:30Z,use_quota=True,user_id='ad8d97fb76b449cf9838c052e89543ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04b9af1-a287-47a4-abfe-fda60738bd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04b9af1-a287-47a4-abfe-fda60738bd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a4e65f-6a97-460c-8cb6-3664b9cb6ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a4e65f-6a97-460c-8cb6-3664b9cb6ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777eada0-ab87-410a-aea9-7c28525b6b83', 'volume_name': 'volume-777eada0-ab87-410a-aea9-7c28525b6b83', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f32dac-be07-4e33-aa5c-874acc56fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f32dac-be07-4e33-aa5c-874acc56fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c3b341-b0ed-4948-b381-d4b72766261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:29 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Volume 777eada0-ab87-410a-aea9-7c28525b6b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777eada0-ab87-410a-aea9-7c28525b6b83', 'volume_size': 1} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1564394659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777eada0-ab87-410a-aea9-7c28525b6b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43591c642894c2284c17d732e62daeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:30Z,use_quota=True,user_id='ad8d97fb76b449cf9838c052e89543ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Creating volume 777eada0-ab87-410a-aea9-7c28525b6b83 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:29 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:29 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 1073741824 Sep 05 20:54:29 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:30 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 1073741824" returned: 0 in 0.789s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:30 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 Sep 05 20:54:30 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:31 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83" returned: 0 in 0.480s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c3b341-b0ed-4948-b381-d4b72766261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777eada0-ab87-410a-aea9-7c28525b6b83', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db718f7-ccf7-4c57-bfbf-4bd35f6b4082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Volume volume-777eada0-ab87-410a-aea9-7c28525b6b83 (777eada0-ab87-410a-aea9-7c28525b6b83): created successfully Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db718f7-ccf7-4c57-bfbf-4bd35f6b4082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Flow 'volume_create_manager' (8a8034b0-bfd2-44c6-af54-3ba4c2c84384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a90fb62f-c3c5-470b-88ac-b7b0dba57203 tempest-VolumesListAdminTestJSON-1890532654 None] Created volume successfully. Sep 05 20:54:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0e1663f6-dc4d-40b9-95f5-953904489d4d tempest-GroupSnapshotsTest-1928087038 None] Group tempest-GroupSnapshotsTest-Group-444895897: creating Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Flow 'volume_create_manager' (c2057655-3376-4dbc-b2d9-6e638f0f732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e94d048-b592-4181-acaa-7e20f3249182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e94d048-b592-4181-acaa-7e20f3249182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1363462602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c2bcdb-467d-49f0-8128-46303635acd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f33a294897c4f6e901ff4bccac5f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:31Z,use_quota=True,user_id='eb6c942c8f254c7cb0e0b3d655491ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8deb8d9b-7981-47a6-b142-d26f41fc49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8deb8d9b-7981-47a6-b142-d26f41fc49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b387a6d0-bca1-4425-b1de-717e9c052db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b387a6d0-bca1-4425-b1de-717e9c052db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c2bcdb-467d-49f0-8128-46303635acd7', 'volume_name': 'volume-35c2bcdb-467d-49f0-8128-46303635acd7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9feb70-5f5b-4965-ad32-62eb951a4017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9feb70-5f5b-4965-ad32-62eb951a4017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a56e3-d6c8-4f03-961b-57727c59d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:31 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Volume 35c2bcdb-467d-49f0-8128-46303635acd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c2bcdb-467d-49f0-8128-46303635acd7', 'volume_size': 1} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1363462602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c2bcdb-467d-49f0-8128-46303635acd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f33a294897c4f6e901ff4bccac5f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:31Z,use_quota=True,user_id='eb6c942c8f254c7cb0e0b3d655491ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Creating volume 35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:31 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0e1663f6-dc4d-40b9-95f5-953904489d4d tempest-GroupSnapshotsTest-1928087038 None] Group tempest-GroupSnapshotsTest-Group-444895897: created successfully Sep 05 20:54:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0e1663f6-dc4d-40b9-95f5-953904489d4d tempest-GroupSnapshotsTest-1928087038 None] Create group completed successfully. Sep 05 20:54:31 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 1073741824 Sep 05 20:54:31 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:32 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 1073741824" returned: 0 in 0.623s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:32 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 Sep 05 20:54:32 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Flow 'volume_create_manager' (0b1d7c6f-a218-4a40-bb0c-46eb1be98997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956a8b4d-745f-485f-b314-1c4f54d7e4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956a8b4d-745f-485f-b314-1c4f54d7e4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1143692576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43591c642894c2284c17d732e62daeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:33Z,use_quota=True,user_id='ad8d97fb76b449cf9838c052e89543ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ba41db-78ed-4cc7-a803-b6050ef46040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ba41db-78ed-4cc7-a803-b6050ef46040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0194f131-6546-4734-ae9b-7c6ac4a17fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:32 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0194f131-6546-4734-ae9b-7c6ac4a17fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea', 'volume_name': 'volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6ddebe-c526-4d07-8fc0-c73ff9362abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6ddebe-c526-4d07-8fc0-c73ff9362abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f9c910-3921-4799-aedd-8daca705a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Volume 05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea', 'volume_size': 1} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7" returned: 0 in 0.502s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1143692576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43591c642894c2284c17d732e62daeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:33Z,use_quota=True,user_id='ad8d97fb76b449cf9838c052e89543ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Creating volume 05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:32 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a56e3-d6c8-4f03-961b-57727c59d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c2bcdb-467d-49f0-8128-46303635acd7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa42fcce-875d-4324-84b6-eb47d6cf7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:32 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea 1073741824 Sep 05 20:54:32 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Volume volume-35c2bcdb-467d-49f0-8128-46303635acd7 (35c2bcdb-467d-49f0-8128-46303635acd7): created successfully Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa42fcce-875d-4324-84b6-eb47d6cf7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Flow 'volume_create_manager' (c2057655-3376-4dbc-b2d9-6e638f0f732d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-28a3d59c-3b82-484d-85f4-54c5b139ec30 tempest-VolumeDependencyTests-881787929 None] Created volume successfully. Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (16b9d6f1-9027-46f8-bb97-f3978a7c315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9744cd-28ae-4d83-970f-b6305f061eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9744cd-28ae-4d83-970f-b6305f061eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-409867151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d849470-3bdf-4bcf-9d76-55e335e562b8,host='devstack@QuobyteHD#QuobyteHD',id=f2e36dd1-50ea-4359-8b05-d3ec388a038a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:33Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aca5f79e-3bd6-4f1a-b3f7-cd69cb179ce2),volume_type_id=aca5f79e-3bd6-4f1a-b3f7-cd69cb179ce2)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d66972-4cae-47d3-93f4-18e08021a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d66972-4cae-47d3-93f4-18e08021a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:33 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfcdc29-4028-4a26-97c7-a25dd5180d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfcdc29-4028-4a26-97c7-a25dd5180d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e36dd1-50ea-4359-8b05-d3ec388a038a', 'volume_name': 'volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63249fde-6bf1-44d7-ada8-3f973d449eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63249fde-6bf1-44d7-ada8-3f973d449eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403a0454-1ab4-4c67-b644-6cf557be39c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Volume f2e36dd1-50ea-4359-8b05-d3ec388a038a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a', 'volume_size': 1} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea 1073741824" returned: 0 in 0.945s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:33 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea Sep 05 20:54:33 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:34 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea" returned: 0 in 0.504s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9d849470-3bdf-4bcf-9d76-55e335e562b8,created_at=2026-09-05T18:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-409867151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d849470-3bdf-4bcf-9d76-55e335e562b8,host='devstack@QuobyteHD#QuobyteHD',id=f2e36dd1-50ea-4359-8b05-d3ec388a038a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:33Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aca5f79e-3bd6-4f1a-b3f7-cd69cb179ce2),volume_type_id=aca5f79e-3bd6-4f1a-b3f7-cd69cb179ce2)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Creating volume f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:34 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f9c910-3921-4799-aedd-8daca705a244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5c4b8a-283d-4767-b8b1-aaab610a8f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:34 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a 1073741824 Sep 05 20:54:34 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Volume volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea (05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea): created successfully Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5c4b8a-283d-4767-b8b1-aaab610a8f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Flow 'volume_create_manager' (0b1d7c6f-a218-4a40-bb0c-46eb1be98997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7acfb386-945b-4b54-9912-6e800c227ae9 tempest-VolumesListAdminTestJSON-1890532654 None] Created volume successfully. Sep 05 20:54:35 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a 1073741824" returned: 0 in 0.970s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:35 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a Sep 05 20:54:35 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Flow 'volume_create_manager' (2abadbf8-e937-4f21-bfa5-73788c398b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095efc0c-9c59-45cf-9319-44177e99a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095efc0c-9c59-45cf-9319-44177e99a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-228842371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b342ab6e-6e72-43ed-879d-d9618b56f854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43591c642894c2284c17d732e62daeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:36Z,use_quota=True,user_id='ad8d97fb76b449cf9838c052e89543ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb693a-143e-4f58-82e0-e3306daac8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfb693a-143e-4f58-82e0-e3306daac8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770105ed-323c-4ab7-9338-3592f48fd30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770105ed-323c-4ab7-9338-3592f48fd30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b342ab6e-6e72-43ed-879d-d9618b56f854', 'volume_name': 'volume-b342ab6e-6e72-43ed-879d-d9618b56f854', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfa2238-4e54-4a5a-80ae-a9479e9d9878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfa2238-4e54-4a5a-80ae-a9479e9d9878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3f7c6a-e9a7-4008-9b62-d02415e09ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Volume b342ab6e-6e72-43ed-879d-d9618b56f854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b342ab6e-6e72-43ed-879d-d9618b56f854', 'volume_size': 1} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a" returned: 0 in 0.361s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.527s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403a0454-1ab4-4c67-b644-6cf557be39c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7894e6-71e1-495c-8974-d6418196438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Creating offline snapshot 13e863c5-0cdd-41d4-98bb-144a1fcc48c5 of volume 35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:54:35 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Volume volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a (f2e36dd1-50ea-4359-8b05-d3ec388a038a): created successfully Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7894e6-71e1-495c-8974-d6418196438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (16b9d6f1-9027-46f8-bb97-f3978a7c315e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e6611e-6ac0-4137-a349-74e89a3b6f2d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:35 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b2c076aa-2f8e-4c59-9f1f-915340495a03 tempest-GroupSnapshotsTest-1928087038 None] Created volume successfully. Sep 05 20:54:35 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 Sep 05 20:54:35 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] GroupSnapshot a0c1cdc6-346c-43ac-8c94-71b00bca262e: creating. Sep 05 20:54:36 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7" returned: 0 in 0.923s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:36 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 1G Sep 05 20:54:36 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Group snapshot a0c1cdc6-346c-43ac-8c94-71b00bca262e: creating. {{(pid=87778) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:54:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:37 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 1G" returned: 0 in 0.549s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c2bcdb-467d-49f0-8128-46303635acd7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:37 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c2bcdb-467d-49f0-8128-46303635acd7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 Sep 05 20:54:37 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:37 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35c2bcdb-467d-49f0-8128-46303635acd7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5" returned: 0 in 0.395s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:37 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 is being set with open permissions: ugo+rw Sep 05 20:54:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:37 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 Sep 05 20:54:37 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:37 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5" returned: 0 in 0.324s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:38 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.info Sep 05 20:54:38 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:38 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.info" returned: 0 in 0.340s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:38 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.info is being set with open permissions: ugo+rw Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:38 devstack sudo[94571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.info Sep 05 20:54:38 devstack sudo[94571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:38 devstack sudo[94571]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.info" returned: 0 in 0.336s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-228842371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b342ab6e-6e72-43ed-879d-d9618b56f854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43591c642894c2284c17d732e62daeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:36Z,use_quota=True,user_id='ad8d97fb76b449cf9838c052e89543ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Creating volume b342ab6e-6e72-43ed-879d-d9618b56f854 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:38 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:38 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 1073741824 Sep 05 20:54:38 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:38 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1b7cc23b-f681-436d-9685-3e459e0f399e tempest-VolumeDependencyTests-881787929 None] Create snapshot completed successfully Sep 05 20:54:39 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 1073741824" returned: 0 in 0.713s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:39 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 Sep 05 20:54:39 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:40 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854" returned: 0 in 0.767s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.543s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3f7c6a-e9a7-4008-9b62-d02415e09ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b342ab6e-6e72-43ed-879d-d9618b56f854', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dbb43b-fce9-4b4e-a57a-17dae529776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Creating offline snapshot 417f726d-043f-455e-9ee4-0c6a57881bff of volume f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:54:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Volume volume-b342ab6e-6e72-43ed-879d-d9618b56f854 (b342ab6e-6e72-43ed-879d-d9618b56f854): created successfully Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3dbb43b-fce9-4b4e-a57a-17dae529776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Flow 'volume_create_manager' (2abadbf8-e937-4f21-bfa5-73788c398b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f351c771-8689-4fff-a9cb-608460f4bf0b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-edf439e9-9017-4b30-afc8-c82fd75714e9 tempest-VolumesListAdminTestJSON-1890532654 None] Created volume successfully. Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Flow 'volume_create_manager' (23528323-eb43-4ae2-86a9-157064a16f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ad8a58-f724-4aa0-a744-dcca3e827e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:40 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a Sep 05 20:54:40 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ad8a58-f724-4aa0-a744-dcca3e827e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-801138536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eacdb33-4676-4460-a2ad-88c027fb2205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f33a294897c4f6e901ff4bccac5f55d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=13e863c5-0cdd-41d4-98bb-144a1fcc48c5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:40Z,use_quota=True,user_id='eb6c942c8f254c7cb0e0b3d655491ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edd9823-f062-42c8-992b-3f14f8b211ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edd9823-f062-42c8-992b-3f14f8b211ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028e0cf-0911-4a14-9c1d-330e324a2165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028e0cf-0911-4a14-9c1d-330e324a2165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2eacdb33-4676-4460-a2ad-88c027fb2205', 'volume_name': 'volume-2eacdb33-4676-4460-a2ad-88c027fb2205', 'volume_size': 1, 'snapshot_id': '13e863c5-0cdd-41d4-98bb-144a1fcc48c5'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08899bc-cec6-4c74-8969-44bb11f57d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c08899bc-cec6-4c74-8969-44bb11f57d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b048526-590c-4561-ae61-a63b9cc0b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Volume 2eacdb33-4676-4460-a2ad-88c027fb2205: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2eacdb33-4676-4460-a2ad-88c027fb2205', 'volume_size': 1, 'snapshot_id': '13e863c5-0cdd-41d4-98bb-144a1fcc48c5'} Sep 05 20:54:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:41 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a" returned: 0 in 0.825s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:41 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff 1G Sep 05 20:54:41 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:42 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff 1G" returned: 0 in 0.785s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:42 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff Sep 05 20:54:42 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:42 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff" returned: 0 in 0.580s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:42 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:54:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:42 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff Sep 05 20:54:42 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:54:43 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Flow 'volume_create_manager' (6bb56fbe-3c32-401c-8d03-73be5f93d33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab26a0c4-dc3d-4b82-a45d-3645d3568ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff" returned: 0 in 0.554s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab26a0c4-dc3d-4b82-a45d-3645d3568ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc287bb-e367-417d-93fb-73c9d3dd237b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc70c3d05bfd462fa55cf4402c25a973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:43Z,use_quota=True,user_id='edfd4be3cf9e4036ad50d230aa154cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22617d9d-4ce0-44ae-a92d-7c164169d9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22617d9d-4ce0-44ae-a92d-7c164169d9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0053cc-089b-4c43-91ff-cf535f6419e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0053cc-089b-4c43-91ff-cf535f6419e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc287bb-e367-417d-93fb-73c9d3dd237b', 'volume_name': 'volume-ecc287bb-e367-417d-93fb-73c9d3dd237b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7ac182-b0ef-4f21-9272-10eeddbd0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7ac182-b0ef-4f21-9272-10eeddbd0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fed086e-4710-4b74-9e27-26f2ec695ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:43 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Volume ecc287bb-e367-417d-93fb-73c9d3dd237b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc287bb-e367-417d-93fb-73c9d3dd237b', 'volume_size': 1} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:43 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.info Sep 05 20:54:43 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:43 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.info" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:43 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:54:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:43 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.info Sep 05 20:54:43 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:44 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.info" returned: 0 in 0.362s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.793s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.300s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-quobyte-13e863c5-0cdd-41d4-98bb-144a1fcc48c5-2eacdb33-4676-4460-a2ad-88c027fb2205" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-13e863c5-0cdd-41d4-98bb-144a1fcc48c5-2eacdb33-4676-4460-a2ad-88c027fb2205" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Creating volume 2eacdb33-4676-4460-a2ad-88c027fb2205 from snapshot 13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-quobyte-2eacdb33-4676-4460-a2ad-88c027fb2205" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-2eacdb33-4676-4460-a2ad-88c027fb2205" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] snapshot: 13e863c5-0cdd-41d4-98bb-144a1fcc48c5, volume: 2eacdb33-4676-4460-a2ad-88c027fb2205, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[85710ff3-3689-4bcc-9192-fe8754e455a2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:44 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-02c47ac8-45e7-4849-91b0-5f4aefc78384 tempest-GroupSnapshotsTest-1928087038 None] group_snapshot a0c1cdc6-346c-43ac-8c94-71b00bca262e: created successfully Sep 05 20:54:44 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 Sep 05 20:54:44 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:44 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5" returned: 0 in 0.683s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35c2bcdb-467d-49f0-8128-46303635acd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfefb91-5804-4041-bf0d-058a74981eb2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:45 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 Sep 05 20:54:45 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:45 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7" returned: 0 in 0.727s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:54:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:45 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 Sep 05 20:54:45 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-6fc5fcc7-12cd-4b45-9f30-0fe345dd2f6c req-409bfb54-7eb1-4ae0-9199-999e100a444c tempest-ServerActionsTestOtherA-1498271619 None] Terminate volume connection completed successfully. Sep 05 20:54:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-6fc5fcc7-12cd-4b45-9f30-0fe345dd2f6c req-409bfb54-7eb1-4ae0-9199-999e100a444c tempest-ServerActionsTestOtherA-1498271619 None] Deleting attachment 5fc4f522-9536-41fc-9f98-b733545644cc. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:54:51 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205" returned: 0 in 6.194s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:51 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:54:51 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Converted 1024.00 MB image at 165.28 MB/s Sep 05 20:54:51 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 is being set with open permissions: ugo+rw Sep 05 20:54:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-6fc5fcc7-12cd-4b45-9f30-0fe345dd2f6c req-0d181adf-b228-4640-bb17-62066d75da47 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:51 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 Sep 05 20:54:51 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-2eacdb33-4676-4460-a2ad-88c027fb2205" released by "_copy_volume_from_snapshot" :: held 8.042s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-13e863c5-0cdd-41d4-98bb-144a1fcc48c5-2eacdb33-4676-4460-a2ad-88c027fb2205" released by "_create_volume_from_snapshot" :: held 8.132s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.165s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.034s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc287bb-e367-417d-93fb-73c9d3dd237b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc70c3d05bfd462fa55cf4402c25a973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:54:43Z,use_quota=True,user_id='edfd4be3cf9e4036ad50d230aa154cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Creating volume ecc287bb-e367-417d-93fb-73c9d3dd237b {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:52 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b 1073741824 Sep 05 20:54:52 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b048526-590c-4561-ae61-a63b9cc0b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eacdb33-4676-4460-a2ad-88c027fb2205', 'volume_size': 1, 'snapshot_id': '13e863c5-0cdd-41d4-98bb-144a1fcc48c5'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7a33ab-e709-4c94-a284-e968f1f21378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:52 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Volume volume-2eacdb33-4676-4460-a2ad-88c027fb2205 (2eacdb33-4676-4460-a2ad-88c027fb2205): created successfully Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7a33ab-e709-4c94-a284-e968f1f21378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Flow 'volume_create_manager' (23528323-eb43-4ae2-86a9-157064a16f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5eb407bf-b0e5-4304-a0fb-b7526a4ea08f tempest-VolumeDependencyTests-881787929 None] Created volume successfully. Sep 05 20:54:52 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b 1073741824" returned: 0 in 0.488s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:52 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b Sep 05 20:54:52 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:53 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b" returned: 0 in 0.281s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.460s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-417f726d-043f-455e-9ee4-0c6a57881bff-378ddb5d-ada1-449c-a045-4a212ed92c86" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fed086e-4710-4b74-9e27-26f2ec695ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc287bb-e367-417d-93fb-73c9d3dd237b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a7339c-ecfa-493a-9948-1eb167c4925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-417f726d-043f-455e-9ee4-0c6a57881bff-378ddb5d-ada1-449c-a045-4a212ed92c86" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Creating volume 378ddb5d-ada1-449c-a045-4a212ed92c86 from snapshot 417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-378ddb5d-ada1-449c-a045-4a212ed92c86" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Volume volume-ecc287bb-e367-417d-93fb-73c9d3dd237b (ecc287bb-e367-417d-93fb-73c9d3dd237b): created successfully Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a7339c-ecfa-493a-9948-1eb167c4925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Flow 'volume_create_manager' (6bb56fbe-3c32-401c-8d03-73be5f93d33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-378ddb5d-ada1-449c-a045-4a212ed92c86" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] snapshot: 417f726d-043f-455e-9ee4-0c6a57881bff, volume: 378ddb5d-ada1-449c-a045-4a212ed92c86, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 20:54:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d21b3964-2839-4313-be93-d62b12853ad7 tempest-VolumesListAdminTestJSON-162310287 None] Created volume successfully. Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-13e863c5-0cdd-41d4-98bb-144a1fcc48c5-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba562fc-648c-4b8d-a385-f86ab7d29a51]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Lock "cinder-13e863c5-0cdd-41d4-98bb-144a1fcc48c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-quobyte-35c2bcdb-467d-49f0-8128-46303635acd7" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-35c2bcdb-467d-49f0-8128-46303635acd7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-quobyte-13e863c5-0cdd-41d4-98bb-144a1fcc48c5" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-13e863c5-0cdd-41d4-98bb-144a1fcc48c5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Deleting offline snapshot 13e863c5-0cdd-41d4-98bb-144a1fcc48c5 of volume 35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] snapshot_file for this snap is: volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4131a1a6-adc8-472f-9251-4a07bcedf2ef]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:53 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff Sep 05 20:54:53 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:53 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 Sep 05 20:54:53 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Acquiring lock "cinder-ecc287bb-e367-417d-93fb-73c9d3dd237b-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Lock "cinder-ecc287bb-e367-417d-93fb-73c9d3dd237b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:53 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff" returned: 0 in 0.509s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ec2f03-12b7-40fe-bbca-d3a18ebfbc9b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Acquiring lock "cinder-quobyte-ecc287bb-e367-417d-93fb-73c9d3dd237b" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Lock "cinder-quobyte-ecc287bb-e367-417d-93fb-73c9d3dd237b" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:53 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5" returned: 0 in 0.501s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35c2bcdb-467d-49f0-8128-46303635acd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b000e57c-b929-4d33-9f9d-aec2bb98204c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "cinder-b342ab6e-6e72-43ed-879d-d9618b56f854-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd89bd2-acbb-4cd7-b82a-6f5e79f2914a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:53 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a Sep 05 20:54:53 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-b342ab6e-6e72-43ed-879d-d9618b56f854-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "cinder-quobyte-b342ab6e-6e72-43ed-879d-d9618b56f854" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-quobyte-b342ab6e-6e72-43ed-879d-d9618b56f854" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c900ab5-36eb-4814-bce4-3475315b8583]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 Sep 05 20:54:54 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b Sep 05 20:54:54 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 Sep 05 20:54:54 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a" returned: 0 in 0.492s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 Sep 05 20:54:54 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b" returned: 0 in 0.475s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b Sep 05 20:54:54 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854" returned: 0 in 0.500s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854 Sep 05 20:54:54 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7" returned: 0 in 0.770s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:54 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 Sep 05 20:54:54 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:54 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ecc287bb-e367-417d-93fb-73c9d3dd237b" returned: 0 in 0.494s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Lock "cinder-quobyte-ecc287bb-e367-417d-93fb-73c9d3dd237b" released by "delete_volume" :: held 1.048s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Created reservations ['9025d839-1ece-43ae-8053-99a0505231b2', '1515d49f-5235-46b9-a035-763a83a04739', 'c8ad5fa2-3a54-4b92-bcdc-e8741567601e', '426e7a79-7864-4025-86eb-58d23a17c959'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:54 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b342ab6e-6e72-43ed-879d-d9618b56f854" returned: 0 in 0.391s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-quobyte-b342ab6e-6e72-43ed-879d-d9618b56f854" released by "delete_volume" :: held 0.954s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:55 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:54:55 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Created reservations ['92c32c75-edfc-4be2-8d82-0c64c623003f', '7d1c3d80-6265-47b5-8241-32b1efae2fe0', '865041d7-b80f-4631-a872-ec15f8f0e4c4', '367e657a-6993-4d59-b440-123ade974501'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:55 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5" returned: 0 in 0.740s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:55 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5 Sep 05 20:54:55 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:55 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:54:55 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:55 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.683s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:55 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:55 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Deleted volume successfully. Sep 05 20:54:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ad1a4393-6d7f-46b0-bb50-78bc947a77ab tempest-VolumesListAdminTestJSON-162310287 None] Lock "cinder-ecc287bb-e367-417d-93fb-73c9d3dd237b-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "cinder-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:56 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7.13e863c5-0cdd-41d4-98bb-144a1fcc48c5" returned: 0 in 1.243s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-13e863c5-0cdd-41d4-98bb-144a1fcc48c5" released by "_delete_snapshot" :: held 3.487s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-35c2bcdb-467d-49f0-8128-46303635acd7" released by "delete_snapshot" :: held 3.538s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "cinder-quobyte-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-quobyte-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea" acquired by "delete_volume" :: waited 0.055s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:57 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 1.428s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=105,cinder:UPDATE=93,cinder:INSERT=33,cinder:DELETE=6 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed81f408-db7b-4413-919c-596e5f928670]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Deleted volume successfully. Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Created reservations ['be1c0121-1d56-4fc3-b053-e7c648f4b533', 'b1d07f73-0a6c-47bb-a288-1d2276645ce3', 'eae43453-996d-4f75-ba75-70d11c7573fc', '24ceb150-7af1-4173-a0c4-5c4aa108c251'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b52bdbe3-91ba-494b-9795-17aaed292d7d tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-b342ab6e-6e72-43ed-879d-d9618b56f854-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:57 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea Sep 05 20:54:57 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=92,cinder:UPDATE=88,cinder:DELETE=11,cinder:INSERT=25 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:54:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Delete snapshot completed successfully. Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-91b4e918-d13c-404a-8137-a6c1507bd19d tempest-VolumeDependencyTests-881787929 None] Lock "cinder-13e863c5-0cdd-41d4-98bb-144a1fcc48c5-delete_snapshot" released by "delete_snapshot" :: held 4.270s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:57 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea" returned: 0 in 0.835s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:58 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea Sep 05 20:54:58 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-35c2bcdb-467d-49f0-8128-46303635acd7-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Lock "cinder-35c2bcdb-467d-49f0-8128-46303635acd7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:58 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea" returned: 0 in 0.595s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-quobyte-35c2bcdb-467d-49f0-8128-46303635acd7" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-quobyte-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea" released by "delete_volume" :: held 1.593s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-35c2bcdb-467d-49f0-8128-46303635acd7" acquired by "delete_volume" :: waited 0.052s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3e3c67-d833-4b1b-b593-c18fad97fb06]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:58 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Created reservations ['f7840a7c-c36a-4aa5-9053-036c38ce1570', '6b53b34d-fda5-43af-91f2-16fe0b525974', 'af93f156-eb11-4259-8c35-fccf7451ae40', '7832ea40-9379-4815-95de-73ef2a452ed1'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:59 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 Sep 05 20:54:59 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:59 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:54:59 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:59 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7" returned: 0 in 1.019s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:54:59 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7 Sep 05 20:54:59 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:54:59 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.750s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:54:59 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:00 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Deleted volume successfully. Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33722dac-4882-416d-8510-71e87aa6288e tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-05523d4d-fc3a-4ad4-9ad0-fca6a8d5e2ea-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "cinder-777eada0-ab87-410a-aea9-7c28525b6b83-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-777eada0-ab87-410a-aea9-7c28525b6b83-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:00 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-35c2bcdb-467d-49f0-8128-46303635acd7" returned: 0 in 0.572s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "cinder-quobyte-777eada0-ab87-410a-aea9-7c28525b6b83" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-35c2bcdb-467d-49f0-8128-46303635acd7" released by "delete_volume" :: held 1.815s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-quobyte-777eada0-ab87-410a-aea9-7c28525b6b83" acquired by "delete_volume" :: waited 0.067s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7873b7-6549-4bed-8cf7-0e550d661da0]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Created reservations ['774da9ed-4d74-4114-88b5-03ca360ac7e9', '08d7221e-dce1-49c6-8f80-261c0c72a6a2', 'b4a3279a-3ef1-4a37-904e-d7a27bb77dcf', '5f1a64de-afec-44f3-9973-2e7e8f1e2be7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:00 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 Sep 05 20:55:00 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:00 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86" returned: 0 in 6.609s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:55:00 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Converted 1024.00 MB image at 154.90 MB/s Sep 05 20:55:00 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:00 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:00 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:01 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:01 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:01 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86" returned: 0 in 0.267s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-378ddb5d-ada1-449c-a045-4a212ed92c86" released by "_copy_volume_from_snapshot" :: held 8.004s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:01 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-417f726d-043f-455e-9ee4-0c6a57881bff-378ddb5d-ada1-449c-a045-4a212ed92c86" released by "_create_volume_from_snapshot" :: held 8.111s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.145s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-6fc5fcc7-12cd-4b45-9f30-0fe345dd2f6c req-0d181adf-b228-4640-bb17-62066d75da47 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.312s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:01 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83" returned: 0 in 0.680s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.352s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:01 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83 Sep 05 20:55:01 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Deleted volume successfully. Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-6fc5fcc7-12cd-4b45-9f30-0fe345dd2f6c req-0d181adf-b228-4640-bb17-62066d75da47 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.119s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-79ffa2fb-35ee-49e0-9785-fa4b081c4cc6 tempest-VolumeDependencyTests-881787929 None] Lock "cinder-35c2bcdb-467d-49f0-8128-46303635acd7-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-6fc5fcc7-12cd-4b45-9f30-0fe345dd2f6c req-0d181adf-b228-4640-bb17-62066d75da47 tempest-ServerActionsTestOtherA-1498271619 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-7082c12d-f854-49bc-b2e6-5337872ad70a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '053eef57-a539-4f78-8997-4562cb90b938', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:55:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ebfbb68c-3910-4e2e-b19b-ab9ef852bc7c tempest-GroupSnapshotsTest-1928087038 None] Create group from source-snapshot-a0c1cdc6-346c-43ac-8c94-71b00bca262e completed successfully. Sep 05 20:55:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-6fc5fcc7-12cd-4b45-9f30-0fe345dd2f6c req-0d181adf-b228-4640-bb17-62066d75da47 tempest-ServerActionsTestOtherA-1498271619 None] attachment_update completed successfully. Sep 05 20:55:01 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777eada0-ab87-410a-aea9-7c28525b6b83" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-quobyte-777eada0-ab87-410a-aea9-7c28525b6b83" released by "delete_volume" :: held 1.187s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Created reservations ['b855b7d1-a9fc-437e-8c39-4b25aafebbef', '9efb230f-d43a-4701-abbd-5fe131f76325', 'dd46423f-968b-4fc0-9642-878e062e4714', '114e9c02-cbf3-40af-967a-2fc65ff3b789'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:01 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:01 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-2eacdb33-4676-4460-a2ad-88c027fb2205-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Lock "cinder-2eacdb33-4676-4460-a2ad-88c027fb2205-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Acquiring lock "cinder-quobyte-2eacdb33-4676-4460-a2ad-88c027fb2205" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-2eacdb33-4676-4460-a2ad-88c027fb2205" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b23da09-ebb2-44b4-9c4d-b9fba8c41f60]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:02 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.708s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Deleted volume successfully. Sep 05 20:55:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-84b97c8c-06e9-4e47-a0aa-e51c30b21103 tempest-VolumesListAdminTestJSON-1890532654 None] Lock "cinder-777eada0-ab87-410a-aea9-7c28525b6b83-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:02 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 Sep 05 20:55:02 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-378ddb5d-ada1-449c-a045-4a212ed92c86" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-378ddb5d-ada1-449c-a045-4a212ed92c86" acquired by "delete_volume" :: waited 0.039s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:03 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205" returned: 0 in 1.233s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:03 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b9cc32-ed22-4205-a195-a303c4cbe61d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:03 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205 Sep 05 20:55:03 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:03 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 Sep 05 20:55:03 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:04 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2eacdb33-4676-4460-a2ad-88c027fb2205" returned: 0 in 0.520s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Lock "cinder-quobyte-2eacdb33-4676-4460-a2ad-88c027fb2205" released by "delete_volume" :: held 1.873s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Created reservations ['23fc081b-5f47-4924-a142-6331db2438e0', '091b2bcb-204a-4590-be45-070bd3378767', '0c82b61c-f21a-42a1-9d28-833b29ee8e84', '898b7673-967b-442d-b66d-0d4e92036a04'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:04 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:04 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:04 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86" returned: 0 in 0.939s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:04 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86 Sep 05 20:55:04 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:04 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.522s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:04 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:04 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:04 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Deleted volume successfully. Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-650d26f5-6e30-48cb-ba3f-77459e9c59cb tempest-VolumeDependencyTests-881787929 None] Lock "cinder-2eacdb33-4676-4460-a2ad-88c027fb2205-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:05 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-378ddb5d-ada1-449c-a045-4a212ed92c86" returned: 0 in 0.626s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-378ddb5d-ada1-449c-a045-4a212ed92c86" released by "delete_volume" :: held 1.767s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['dfa754cd-d630-42ff-83be-05eb9c287bc4'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:05 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.805s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:55:05 devstack cinder-volume[87778]: WARNING cinder.quota [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1409299012 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1409299012, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:05 devstack cinder-volume[87778]: WARNING cinder.quota [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1409299012 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1409299012, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:05 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['84faa29d-94d7-43a4-a312-03b083b514f0', '4f1e6243-303f-4fa8-a082-15f6aa262acb', 'f74eeb3d-807a-4efb-96bf-65114baa61cb', '51f2b183-d1bf-48cd-9148-133a088778d1'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:06 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:06 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:06 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.390s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:06 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-118706ce-a750-436d-a526-c0f8d070b9b7 tempest-GroupSnapshotsTest-1928087038 None] Delete group completed successfully. Sep 05 20:55:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] group_snapshot a0c1cdc6-346c-43ac-8c94-71b00bca262e: deleting Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] group_snapshot a0c1cdc6-346c-43ac-8c94-71b00bca262e: deleting {{(pid=87778) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-f2e36dd1-50ea-4359-8b05-d3ec388a038a" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-f2e36dd1-50ea-4359-8b05-d3ec388a038a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-417f726d-043f-455e-9ee4-0c6a57881bff" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-417f726d-043f-455e-9ee4-0c6a57881bff" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Deleting offline snapshot 417f726d-043f-455e-9ee4-0c6a57881bff of volume f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] snapshot_file for this snap is: volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a55534-7ed1-4927-9c39-37e4d9065fee]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:07 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff Sep 05 20:55:07 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:07 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff" returned: 0 in 0.648s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:08 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4512c34c-f9f3-4572-9812-a881540860cb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:08 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a Sep 05 20:55:08 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:09 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a" returned: 0 in 1.344s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:09 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff Sep 05 20:55:09 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:10 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff" returned: 0 in 0.657s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:10 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff Sep 05 20:55:10 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:10 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a.417f726d-043f-455e-9ee4-0c6a57881bff" returned: 0 in 0.535s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-417f726d-043f-455e-9ee4-0c6a57881bff" released by "_delete_snapshot" :: held 3.364s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-f2e36dd1-50ea-4359-8b05-d3ec388a038a" released by "delete_snapshot" :: held 3.401s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:10 devstack cinder-volume[87778]: WARNING cinder.quota [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1409299012 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1409299012, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:10 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['219b69d0-8731-40e4-a121-b5d450b4c41c', '5bfa2e72-37bb-4a6b-a2c3-4f19c90ca221', '3c2141be-c6b3-4bc2-8fe5-d1620566c0eb', 'e7e56235-f4f6-4046-bf27-6674a1e6d8a7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-06fbd963-51c4-4482-9995-698f6a5e403a tempest-GroupSnapshotsTest-1928087038 None] group_snapshot a0c1cdc6-346c-43ac-8c94-71b00bca262e: deleted successfully Sep 05 20:55:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-f2e36dd1-50ea-4359-8b05-d3ec388a038a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-f2e36dd1-50ea-4359-8b05-d3ec388a038a" acquired by "delete_volume" :: waited 0.057s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[640e0e4e-8826-457a-ad26-bb5739672b2a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:12 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a Sep 05 20:55:12 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:13 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a" returned: 0 in 0.628s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:13 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a Sep 05 20:55:13 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:13 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f2e36dd1-50ea-4359-8b05-d3ec388a038a" returned: 0 in 0.497s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-f2e36dd1-50ea-4359-8b05-d3ec388a038a" released by "delete_volume" :: held 1.280s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['13b0fe48-4484-4c57-aaf5-c9b4d245dcae'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:14 devstack cinder-volume[87778]: WARNING cinder.db.api [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1409299012'] Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['1eb86083-ac13-4065-8511-3324bf720969', '13b57f57-c4d1-426c-a359-72ef65474656', 'e7858b4f-e730-4ec9-8fbb-a61206a46fdf', '889a23b1-6022-4535-b346-cc0a27fccf8a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:14 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:14 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:14 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:14 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cc128081-01c0-43c1-a4bc-609923ee931a tempest-GroupSnapshotsTest-1928087038 None] Delete group completed successfully. Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Flow 'volume_create_manager' (bcfa1fb9-ad5d-4cb9-a448-0cc44f53d25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7412d0dc-49ed-4713-bf58-53014b966c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7412d0dc-49ed-4713-bf58-53014b966c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135237660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f19070beccd40af86729f391e591a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:15Z,use_quota=True,user_id='d4e55a4c83954b02bb020feabf089e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce60214a-f73f-4a69-a0bc-d62f50f34085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce60214a-f73f-4a69-a0bc-d62f50f34085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf0d4cb-7e72-43db-9aa9-0d17e55b5c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf0d4cb-7e72-43db-9aa9-0d17e55b5c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9', 'volume_name': 'volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ff3c44-153e-4c66-9174-f222680eb597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ff3c44-153e-4c66-9174-f222680eb597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8363cc8-9bd6-4f41-838c-9905ea84f9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:15 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Volume 965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9', 'volume_size': 1} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1135237660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f19070beccd40af86729f391e591a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:15Z,use_quota=True,user_id='d4e55a4c83954b02bb020feabf089e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Creating volume 965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:55:15 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:55:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:15 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 1073741824 Sep 05 20:55:15 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9c6807a4-192c-4c7f-bb18-133116a06a5a tempest-GroupSnapshotsTest-1928087038 None] Group tempest-GroupSnapshotsTest-Group-1894275789: creating Sep 05 20:55:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9c6807a4-192c-4c7f-bb18-133116a06a5a tempest-GroupSnapshotsTest-1928087038 None] Group tempest-GroupSnapshotsTest-Group-1894275789: created successfully Sep 05 20:55:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9c6807a4-192c-4c7f-bb18-133116a06a5a tempest-GroupSnapshotsTest-1928087038 None] Create group completed successfully. Sep 05 20:55:16 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 1073741824" returned: 0 in 0.762s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:16 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 Sep 05 20:55:16 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:16 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" returned: 0 in 0.357s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8363cc8-9bd6-4f41-838c-9905ea84f9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47a866a-3301-4f2a-abcf-707e1619fa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:16 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Volume volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 (965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9): created successfully Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47a866a-3301-4f2a-abcf-707e1619fa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Flow 'volume_create_manager' (bcfa1fb9-ad5d-4cb9-a448-0cc44f53d25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d67e311a-8c74-4906-8254-1b4accc14799 tempest-SnapshotMetadataTestJSON-736185719 None] Created volume successfully. Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Creating offline snapshot 0f5236fd-4239-4c36-bb7d-89111fdb1bec of volume 965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf05812-f438-4952-bc65-726c6f1d3c51]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:18 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 Sep 05 20:55:18 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (d4aa979d-1914-423e-826d-99bfd88131b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65de63a-f2a2-4a6a-a702-456b6a470ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65de63a-f2a2-4a6a-a702-456b6a470ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-431221071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05fdcf12-cd49-4ad2-b8e3-6c36de3cf056,host='devstack@QuobyteHD#QuobyteHD',id=a30bd9f8-8f23-4358-821c-03c4c13b2709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:18Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac54fc18-b28f-4edc-8f09-7b4ee1298b58),volume_type_id=ac54fc18-b28f-4edc-8f09-7b4ee1298b58)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90b5b12-49df-429d-8620-f75b124d1349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90b5b12-49df-429d-8620-f75b124d1349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b975e9bd-9691-46d5-afc6-a9f04243dc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b975e9bd-9691-46d5-afc6-a9f04243dc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30bd9f8-8f23-4358-821c-03c4c13b2709', 'volume_name': 'volume-a30bd9f8-8f23-4358-821c-03c4c13b2709', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054afad1-ec32-4d83-a359-30d3d1a35bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054afad1-ec32-4d83-a359-30d3d1a35bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3071f44c-7b90-4ddf-a854-82288077a178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Volume a30bd9f8-8f23-4358-821c-03c4c13b2709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30bd9f8-8f23-4358-821c-03c4c13b2709', 'volume_size': 1} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:18 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" returned: 0 in 0.442s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:18 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec 1G Sep 05 20:55:18 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:19 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec 1G" returned: 0 in 0.431s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:19 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec Sep 05 20:55:19 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:19 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec" returned: 0 in 0.332s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:19 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec is being set with open permissions: ugo+rw Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:19 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec Sep 05 20:55:19 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:19 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec" returned: 0 in 0.297s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:19 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.info Sep 05 20:55:19 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:19 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.info" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:19 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.info is being set with open permissions: ugo+rw Sep 05 20:55:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:20 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.info Sep 05 20:55:20 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:20 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.info" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.877s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05fdcf12-cd49-4ad2-b8e3-6c36de3cf056,created_at=2026-09-05T18:55:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-431221071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05fdcf12-cd49-4ad2-b8e3-6c36de3cf056,host='devstack@QuobyteHD#QuobyteHD',id=a30bd9f8-8f23-4358-821c-03c4c13b2709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:18Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac54fc18-b28f-4edc-8f09-7b4ee1298b58),volume_type_id=ac54fc18-b28f-4edc-8f09-7b4ee1298b58)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Creating volume a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:55:20 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:20 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 1073741824 Sep 05 20:55:20 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3b808a62-134c-47c1-935e-ca358e0fbfd7 tempest-SnapshotMetadataTestJSON-736185719 None] Create snapshot completed successfully Sep 05 20:55:20 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 1073741824" returned: 0 in 0.511s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:20 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 Sep 05 20:55:20 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:21 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709" returned: 0 in 0.304s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3071f44c-7b90-4ddf-a854-82288077a178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30bd9f8-8f23-4358-821c-03c4c13b2709', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830b3e99-f4dd-452a-a040-4215c8388753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:21 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Volume volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 (a30bd9f8-8f23-4358-821c-03c4c13b2709): created successfully Sep 05 20:55:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830b3e99-f4dd-452a-a040-4215c8388753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (d4aa979d-1914-423e-826d-99bfd88131b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4f71176b-6d77-4fbe-9076-8bce4e3b0c39 tempest-GroupSnapshotsTest-1928087038 None] Created volume successfully. Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "cinder-0f5236fd-4239-4c36-bb7d-89111fdb1bec-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-0f5236fd-4239-4c36-bb7d-89111fdb1bec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "cinder-quobyte-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-quobyte-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "cinder-quobyte-0f5236fd-4239-4c36-bb7d-89111fdb1bec" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-quobyte-0f5236fd-4239-4c36-bb7d-89111fdb1bec" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Deleting offline snapshot 0f5236fd-4239-4c36-bb7d-89111fdb1bec of volume 965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] snapshot_file for this snap is: volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0915c8b7-db0f-497f-9ee1-c458343d18ec]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (cf692e67-957b-4410-b370-9ca72644c010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:22 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec Sep 05 20:55:22 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fbd55c-4f48-444e-a84a-eaa49d20db7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fbd55c-4f48-444e-a84a-eaa49d20db7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81490452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05fdcf12-cd49-4ad2-b8e3-6c36de3cf056,host='devstack@QuobyteHD#QuobyteHD',id=75ca1446-a38f-479e-bb13-e9a94be560df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:22Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac54fc18-b28f-4edc-8f09-7b4ee1298b58),volume_type_id=ac54fc18-b28f-4edc-8f09-7b4ee1298b58)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1829f25f-aa8d-4967-b3a6-04003ddbce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1829f25f-aa8d-4967-b3a6-04003ddbce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f347322f-96a7-4821-b8bc-e1bff83f9a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f347322f-96a7-4821-b8bc-e1bff83f9a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ca1446-a38f-479e-bb13-e9a94be560df', 'volume_name': 'volume-75ca1446-a38f-479e-bb13-e9a94be560df', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e428815-3649-4dfd-8000-3889e789ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e428815-3649-4dfd-8000-3889e789ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd698d-28e5-4dde-b36a-99bb2c7aa8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:22 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Volume 75ca1446-a38f-479e-bb13-e9a94be560df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ca1446-a38f-479e-bb13-e9a94be560df', 'volume_size': 1} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=05fdcf12-cd49-4ad2-b8e3-6c36de3cf056,created_at=2026-09-05T18:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-81490452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=05fdcf12-cd49-4ad2-b8e3-6c36de3cf056,host='devstack@QuobyteHD#QuobyteHD',id=75ca1446-a38f-479e-bb13-e9a94be560df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:22Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac54fc18-b28f-4edc-8f09-7b4ee1298b58),volume_type_id=ac54fc18-b28f-4edc-8f09-7b4ee1298b58)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Creating volume 75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:55:22 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:22 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df 1073741824 Sep 05 20:55:22 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:22 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec" returned: 0 in 0.523s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfb8cf7-74dc-47ab-b08b-aafadf7d6e4c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:23 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 Sep 05 20:55:23 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:23 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df 1073741824" returned: 0 in 0.554s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:23 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df Sep 05 20:55:23 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:23 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" returned: 0 in 0.480s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:23 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec Sep 05 20:55:23 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:23 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df" returned: 0 in 0.355s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11bd698d-28e5-4dde-b36a-99bb2c7aa8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ca1446-a38f-479e-bb13-e9a94be560df', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8b7c25-29c0-4ce8-8038-512b0e4e9059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:23 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Volume volume-75ca1446-a38f-479e-bb13-e9a94be560df (75ca1446-a38f-479e-bb13-e9a94be560df): created successfully Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8b7c25-29c0-4ce8-8038-512b0e4e9059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (cf692e67-957b-4410-b370-9ca72644c010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e745e8db-0c42-4797-91f4-f8a4f7b9002e tempest-GroupSnapshotsTest-1928087038 None] Created volume successfully. Sep 05 20:55:24 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec" returned: 0 in 0.539s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:24 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec Sep 05 20:55:24 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:24 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9.0f5236fd-4239-4c36-bb7d-89111fdb1bec" returned: 0 in 0.305s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-quobyte-0f5236fd-4239-4c36-bb7d-89111fdb1bec" released by "_delete_snapshot" :: held 1.989s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-quobyte-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" released by "delete_snapshot" :: held 2.030s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:24 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Created reservations ['e1582fc2-3135-4176-af86-a7dbc2ec6414', '3cc7a3e0-566b-466f-b058-ecdc2d2dad02', '2b0b4886-6074-4b29-a100-3ede403ec720', '6d63a08f-7c0f-44c1-ae2c-9a856c461a64'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Delete snapshot completed successfully. Sep 05 20:55:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-154e98c1-abef-4d4b-aa7e-057c51484e3a tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-0f5236fd-4239-4c36-bb7d-89111fdb1bec-delete_snapshot" released by "delete_snapshot" :: held 2.255s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-56f6c001-49d4-466e-8de9-929258ce65f8 tempest-GroupSnapshotsTest-1928087038 None] Update group completed successfully. Sep 05 20:55:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "cinder-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "cinder-quobyte-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-quobyte-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:25 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b1dcea-d70a-4983-9b44-0baa96e00829]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:25 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 Sep 05 20:55:25 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:26 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" returned: 0 in 0.430s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:26 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9 Sep 05 20:55:26 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:26 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" returned: 0 in 0.301s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-quobyte-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9" released by "delete_volume" :: held 0.811s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fa2ceacb-30ee-4850-ac4a-c7afb5043ec0 tempest-GroupSnapshotsTest-1928087038 None] Update group completed successfully. Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Created reservations ['b1ec1382-f243-4232-b956-064521467105', '9ffd77ed-a513-4ff0-950c-43418b2d6791', '8d3d72ec-aada-483f-974e-803f35965e61', '5bbf3a2e-14f9-4e01-9960-7953593949fd'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:26 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:26 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:27 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:27 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Deleted volume successfully. Sep 05 20:55:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f679d529-9410-4ffa-b269-87c6f5ccc4cf tempest-SnapshotMetadataTestJSON-736185719 None] Lock "cinder-965a7f5f-5d3c-4422-8cb2-2b59c5cf96d9-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-097ce8ae-e625-42c8-9b1e-9d9f7a046264 tempest-GroupSnapshotsTest-1928087038 None] Update group completed successfully. Sep 05 20:55:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-29f78615-0dad-4448-94e7-b265c4f7c496 tempest-GroupSnapshotsTest-1928087038 None] Update group completed successfully. Sep 05 20:55:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] GroupSnapshot 6adf74f6-c3d7-4895-93ff-03c8f2da2dd9: creating. Sep 05 20:55:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Group snapshot 6adf74f6-c3d7-4895-93ff-03c8f2da2dd9: creating. {{(pid=87778) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:55:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Creating offline snapshot 1ce192d9-af04-4e5f-ac76-4f2c6b048c75 of volume a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:55:30 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eef7b1-45af-494f-979c-d0550d8bfd98]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:30 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 Sep 05 20:55:30 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:31 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709" returned: 0 in 0.439s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:31 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 1G Sep 05 20:55:31 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:31 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 1G" returned: 0 in 0.547s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:31 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 Sep 05 20:55:31 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:32 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75" returned: 0 in 0.434s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:32 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:32 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 Sep 05 20:55:32 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Flow 'volume_create_manager' (b4f3659b-31af-4dd0-81ec-bb0f71b520b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a6cecc-b648-436f-a9cf-546bcad1f6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a6cecc-b648-436f-a9cf-546bcad1f6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1303410789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6553348-3f8b-4237-ac8e-553e6d507fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7c98b7ea8745969a58c83a35d12a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:32Z,use_quota=True,user_id='bc9c6bac95bc42bbad2d0618cfafeea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d813ea-9c81-4339-a39c-7d11e1c2cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d813ea-9c81-4339-a39c-7d11e1c2cfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef5eb89-096e-433f-bdea-c4e252b9ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef5eb89-096e-433f-bdea-c4e252b9ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6553348-3f8b-4237-ac8e-553e6d507fd2', 'volume_name': 'volume-a6553348-3f8b-4237-ac8e-553e6d507fd2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a9bc9a-4392-4085-b95b-72e7b1fc9020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a9bc9a-4392-4085-b95b-72e7b1fc9020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6cdca8-7c4a-499c-8caa-4c0a910a41f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Volume a6553348-3f8b-4237-ac8e-553e6d507fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6553348-3f8b-4237-ac8e-553e6d507fd2', 'volume_size': 1} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:32 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:32 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.info Sep 05 20:55:32 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:32 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.info" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:32 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:55:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:32 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.info Sep 05 20:55:32 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:33 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.info" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Creating offline snapshot c627949c-561f-449b-af85-55e612a6e6d1 of volume 75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8bd92b-1888-44e7-9d9f-d208240afade]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:33 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df Sep 05 20:55:33 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:33 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df" returned: 0 in 0.421s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:33 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 1G Sep 05 20:55:33 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:33 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 1G" returned: 0 in 0.478s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ca1446-a38f-479e-bb13-e9a94be560df -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:34 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ca1446-a38f-479e-bb13-e9a94be560df -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 Sep 05 20:55:34 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:34 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ca1446-a38f-479e-bb13-e9a94be560df -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:34 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:55:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:34 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 Sep 05 20:55:34 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:34 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1" returned: 0 in 0.337s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:34 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.info Sep 05 20:55:34 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:35 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.info" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:35 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:35 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.info Sep 05 20:55:35 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:35 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.info" returned: 0 in 0.261s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.889s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1303410789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6553348-3f8b-4237-ac8e-553e6d507fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7c98b7ea8745969a58c83a35d12a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:32Z,use_quota=True,user_id='bc9c6bac95bc42bbad2d0618cfafeea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Creating volume a6553348-3f8b-4237-ac8e-553e6d507fd2 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:55:35 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:35 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 1073741824 Sep 05 20:55:35 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:35 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ed715af8-d0aa-4224-89ac-e4ac63658cfe tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 6adf74f6-c3d7-4895-93ff-03c8f2da2dd9: created successfully Sep 05 20:55:35 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 1073741824" returned: 0 in 0.489s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:35 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 Sep 05 20:55:35 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:36 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2" returned: 0 in 0.286s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6cdca8-7c4a-499c-8caa-4c0a910a41f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6553348-3f8b-4237-ac8e-553e6d507fd2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cb365b-ee80-47a0-95b7-f8366db3e2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 6adf74f6-c3d7-4895-93ff-03c8f2da2dd9: deleting Sep 05 20:55:36 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Volume volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 (a6553348-3f8b-4237-ac8e-553e6d507fd2): created successfully Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cb365b-ee80-47a0-95b7-f8366db3e2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Flow 'volume_create_manager' (b4f3659b-31af-4dd0-81ec-bb0f71b520b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 6adf74f6-c3d7-4895-93ff-03c8f2da2dd9: deleting {{(pid=87778) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:55:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-161473f6-c4e4-407c-88a6-98883ee14f84 tempest-AbsoluteLimitsTests-785705982 None] Created volume successfully. Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-a30bd9f8-8f23-4358-821c-03c4c13b2709" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-a30bd9f8-8f23-4358-821c-03c4c13b2709" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-1ce192d9-af04-4e5f-ac76-4f2c6b048c75" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-1ce192d9-af04-4e5f-ac76-4f2c6b048c75" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Deleting offline snapshot 1ce192d9-af04-4e5f-ac76-4f2c6b048c75 of volume a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] snapshot_file for this snap is: volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a92132-448f-4984-81d1-dbd824f273c6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:36 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 Sep 05 20:55:36 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:36 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75" returned: 0 in 0.543s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30bd9f8-8f23-4358-821c-03c4c13b2709(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Acquiring lock "cinder-a6553348-3f8b-4237-ac8e-553e6d507fd2-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ee52f-1b53-4d6d-994c-a8016a36e405]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Lock "cinder-a6553348-3f8b-4237-ac8e-553e6d507fd2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Acquiring lock "cinder-quobyte-a6553348-3f8b-4237-ac8e-553e6d507fd2" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Lock "cinder-quobyte-a6553348-3f8b-4237-ac8e-553e6d507fd2" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e383f-6083-43d8-b2c2-418a75eb6ca6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:37 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 Sep 05 20:55:37 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:37 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 Sep 05 20:55:37 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:37 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709" returned: 0 in 0.631s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:37 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 Sep 05 20:55:37 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:37 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2" returned: 0 in 0.645s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:37 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2 Sep 05 20:55:37 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:38 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75" returned: 0 in 0.460s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:38 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a6553348-3f8b-4237-ac8e-553e6d507fd2" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Lock "cinder-quobyte-a6553348-3f8b-4237-ac8e-553e6d507fd2" released by "delete_volume" :: held 1.031s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:38 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75 Sep 05 20:55:38 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Created reservations ['0fb8850a-7d0c-4da3-a11e-e6fd93bb8b6b', 'b8ef6487-e0cb-482c-813d-0ae71b93ccf8', 'b2ba5b2a-b53e-4dc0-8733-b0ab12831432', 'fd9897b5-a3f0-4d2a-a257-ca7048c60a03'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:38 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:38 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:38 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709.1ce192d9-af04-4e5f-ac76-4f2c6b048c75" returned: 0 in 0.338s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-1ce192d9-af04-4e5f-ac76-4f2c6b048c75" released by "_delete_snapshot" :: held 2.124s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-a30bd9f8-8f23-4358-821c-03c4c13b2709" released by "delete_snapshot" :: held 2.157s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-75ca1446-a38f-479e-bb13-e9a94be560df" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-75ca1446-a38f-479e-bb13-e9a94be560df" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-c627949c-561f-449b-af85-55e612a6e6d1" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-c627949c-561f-449b-af85-55e612a6e6d1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Deleting offline snapshot c627949c-561f-449b-af85-55e612a6e6d1 of volume 75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] snapshot_file for this snap is: volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c9d89-75ab-4bec-9565-ddf521ef5567]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:38 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.315s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:38 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Deleted volume successfully. Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4a889d81-f575-46bd-9512-8e0dde9aa018 tempest-AbsoluteLimitsTests-785705982 None] Lock "cinder-a6553348-3f8b-4237-ac8e-553e6d507fd2-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:38 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 Sep 05 20:55:38 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:38 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1" returned: 0 in 0.423s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ca1446-a38f-479e-bb13-e9a94be560df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fe0db0-6bf7-4291-9972-3dab509d5932]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:39 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df Sep 05 20:55:39 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:39 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df" returned: 0 in 0.470s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:39 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 Sep 05 20:55:39 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-fdd3f07a-8c69-423e-88ff-cc82fb1ea1be tempest-ServerActionsTestOtherA-1498271619 None] Terminate volume connection completed successfully. Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-fdd3f07a-8c69-423e-88ff-cc82fb1ea1be tempest-ServerActionsTestOtherA-1498271619 None] Deleting attachment 053eef57-a539-4f78-8997-4562cb90b938. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:55:40 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1" returned: 0 in 0.655s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:40 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1 Sep 05 20:55:40 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "cinder-7082c12d-f854-49bc-b2e6-5337872ad70a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-7082c12d-f854-49bc-b2e6-5337872ad70a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "cinder-quobyte-7082c12d-f854-49bc-b2e6-5337872ad70a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-quobyte-7082c12d-f854-49bc-b2e6-5337872ad70a" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:40 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6c6e2-79d3-490b-99fb-dc716d0bb588]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df.c627949c-561f-449b-af85-55e612a6e6d1" returned: 0 in 0.406s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-c627949c-561f-449b-af85-55e612a6e6d1" released by "_delete_snapshot" :: held 2.082s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-75ca1446-a38f-479e-bb13-e9a94be560df" released by "delete_snapshot" :: held 2.118s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:40 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a Sep 05 20:55:40 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:40 devstack cinder-volume[87778]: WARNING cinder.quota [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-875679417 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-875679417, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:40 devstack cinder-volume[87778]: WARNING cinder.quota [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-875679417 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-875679417, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:40 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['6a807a8b-3d71-4529-a170-9d020a2db1f2', '577387df-4803-49ba-af2f-96f01447677c', 'ce0c3ff9-07b1-4673-a8cf-c8ec653f01c4', '7e15a4be-329b-49a2-a5ee-b3a32153320d'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['0d314d59-ee24-4220-8015-d757d7855e1e', 'f2d415f9-a9a0-4ed8-9bc8-a171994c4160', '6e5add5f-88cc-4c8c-8915-a151f5653929', 'd2683dc7-fd9a-4fc8-a4ee-e9471dfb10fe'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:41 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ac78a799-e365-4803-9ea3-4dea5429f0c4 tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 6adf74f6-c3d7-4895-93ff-03c8f2da2dd9: deleted successfully Sep 05 20:55:41 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a" returned: 0 in 0.756s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:41 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a Sep 05 20:55:41 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:41 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7082c12d-f854-49bc-b2e6-5337872ad70a" returned: 0 in 0.329s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-quobyte-7082c12d-f854-49bc-b2e6-5337872ad70a" released by "delete_volume" :: held 1.161s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG cinder.quota [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Created reservations ['25e145f4-78c5-4e5a-ac6e-08aa5375b2e1', '7ff5b884-8a50-4158-901e-a34cde97db0f', 'dc62cb7c-d6fc-4cf0-aeaf-edf90d981d36', 'e3b78e9b-209c-4b5b-85f6-5f55dbff9e93'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:41 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:41 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:42 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.334s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.manager [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Deleted volume successfully. Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-1735fa34-351c-4bfe-9efa-63146260d6ef req-bb000b63-bdc6-4b2a-988e-d8a78062d620 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-7082c12d-f854-49bc-b2e6-5337872ad70a-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-75ca1446-a38f-479e-bb13-e9a94be560df" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-75ca1446-a38f-479e-bb13-e9a94be560df" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "cinder-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4054c5-58e6-4e74-9aaa-209574f5394e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "cinder-quobyte-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-quobyte-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:42 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df Sep 05 20:55:42 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad3530-46d4-4c5c-8996-3892e5565387]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:42 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb Sep 05 20:55:42 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:43 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df" returned: 0 in 0.460s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:43 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df Sep 05 20:55:43 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:43 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb" returned: 0 in 0.437s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:43 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb Sep 05 20:55:43 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:43 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-75ca1446-a38f-479e-bb13-e9a94be560df" returned: 0 in 0.326s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-75ca1446-a38f-479e-bb13-e9a94be560df" released by "delete_volume" :: held 0.916s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-a30bd9f8-8f23-4358-821c-03c4c13b2709" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-a30bd9f8-8f23-4358-821c-03c4c13b2709" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1bb9eb-9a5a-474d-b32d-154d05ea5688]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:43 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb" returned: 0 in 0.302s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-quobyte-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb" released by "delete_volume" :: held 0.794s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Created reservations ['dcf38f4a-64d1-4196-952b-307716bdac7e', 'c831abc3-54f1-43ff-9c01-d9b3ea1186f0', 'bac472ac-b75e-41ef-af69-a13277bf6ab7', '09e4cd09-97d1-479a-9cf6-e4a76ffdcd84'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:43 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 Sep 05 20:55:43 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:43 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:43 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:44 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709" returned: 0 in 0.608s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:44 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709 Sep 05 20:55:44 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:44 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.419s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:44 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Deleted volume successfully. Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d38d6ba-8e7d-42f0-93e4-977f7c4f99e9 tempest-ServerActionsTestOtherA-1498271619 None] Lock "cinder-9e6922ea-bb8f-4ea4-bb6e-0ad49bb8edfb-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:44 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a30bd9f8-8f23-4358-821c-03c4c13b2709" returned: 0 in 0.447s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-a30bd9f8-8f23-4358-821c-03c4c13b2709" released by "delete_volume" :: held 1.163s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['9865fb15-b6ac-4b13-8feb-66e65963d906'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:44 devstack cinder-volume[87778]: WARNING cinder.quota [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-875679417 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-875679417, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:44 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['f63c4f26-5cad-4311-854a-5e2c15af773d', 'acd09327-5634-4c56-afaa-d12ce9c22ec9', 'bd201e34-e450-43ff-8030-d690e80e4d0a', '65558b79-c2cd-497d-b9f5-640f8a00c7fa'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['10a1ee13-0931-4d7f-933d-ccf6308ddc83', 'ddf74ba0-e4f6-4f8d-bca5-efd14e188247', 'f18183c0-73fe-4373-a805-d922bb0cd809', '2e013a39-d290-4e3c-b967-f99af5da544b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:45 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:45 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:45 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.479s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:45 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f89911e0-145a-43dd-91fb-47a186226938 tempest-GroupSnapshotsTest-1928087038 None] Delete group completed successfully. Sep 05 20:55:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2987a871-44f8-4129-b050-3f00d631a1de tempest-GroupSnapshotsTest-1928087038 None] Group tempest-GroupSnapshotsTest-Group-1603109607: creating Sep 05 20:55:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2987a871-44f8-4129-b050-3f00d631a1de tempest-GroupSnapshotsTest-1928087038 None] Group tempest-GroupSnapshotsTest-Group-1603109607: created successfully Sep 05 20:55:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2987a871-44f8-4129-b050-3f00d631a1de tempest-GroupSnapshotsTest-1928087038 None] Create group completed successfully. Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Flow 'volume_create_manager' (d6273d90-71c7-4df0-bf01-f64eee768a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bcdb75-bfdd-4481-b558-100e336d0c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bcdb75-bfdd-4481-b558-100e336d0c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-330514785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253f0263-172e-4fed-9870-365c1edf5dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348eb2c35b64add83332f9236b57763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:48Z,use_quota=True,user_id='52579266315b4a92873ced9e24033908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3e5375-3251-41d8-957f-0d88901153ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3e5375-3251-41d8-957f-0d88901153ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb884c26-09a0-4c7f-a157-d62e7fd16396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb884c26-09a0-4c7f-a157-d62e7fd16396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253f0263-172e-4fed-9870-365c1edf5dff', 'volume_name': 'volume-253f0263-172e-4fed-9870-365c1edf5dff', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3bf598-81f1-40ad-b6c7-c754cf2d01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3bf598-81f1-40ad-b6c7-c754cf2d01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05521cf-c475-4e54-9d32-4043870de7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Volume 253f0263-172e-4fed-9870-365c1edf5dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253f0263-172e-4fed-9870-365c1edf5dff', 'volume_size': 1} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-330514785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253f0263-172e-4fed-9870-365c1edf5dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348eb2c35b64add83332f9236b57763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:48Z,use_quota=True,user_id='52579266315b4a92873ced9e24033908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Creating volume 253f0263-172e-4fed-9870-365c1edf5dff {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:55:48 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:48 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff 1073741824 Sep 05 20:55:48 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (d00904ff-1062-48b2-8e23-5f6f80651f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce491e9-21f9-4a73-b400-16e1d7e31887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce491e9-21f9-4a73-b400-16e1d7e31887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870629618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1064e92b-36c0-48af-9222-ae773e550219,host='devstack@QuobyteHD#QuobyteHD',id=777e297b-9878-4c18-a02c-76cbc364ece1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:49Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d96ab33c-922e-401a-ac7b-5b8236f59a63),volume_type_id=d96ab33c-922e-401a-ac7b-5b8236f59a63)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989ad3e1-8fbf-451f-b860-d01c3c10393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989ad3e1-8fbf-451f-b860-d01c3c10393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1edc288-eb8a-4a5c-8c4b-48652b9f9c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1edc288-eb8a-4a5c-8c4b-48652b9f9c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777e297b-9878-4c18-a02c-76cbc364ece1', 'volume_name': 'volume-777e297b-9878-4c18-a02c-76cbc364ece1', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3651b871-b164-4021-8fa0-f94d97949caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3651b871-b164-4021-8fa0-f94d97949caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d6234-501e-463d-a652-1f5a99839cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:48 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Volume 777e297b-9878-4c18-a02c-76cbc364ece1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777e297b-9878-4c18-a02c-76cbc364ece1', 'volume_size': 1} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:48 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff 1073741824" returned: 0 in 0.656s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:49 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff Sep 05 20:55:49 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:49 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1064e92b-36c0-48af-9222-ae773e550219,created_at=2026-09-05T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870629618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1064e92b-36c0-48af-9222-ae773e550219,host='devstack@QuobyteHD#QuobyteHD',id=777e297b-9878-4c18-a02c-76cbc364ece1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb217409097748358a76633a4367ef8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:49Z,use_quota=True,user_id='804a348584274dfb9f438913d2e92967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d96ab33c-922e-401a-ac7b-5b8236f59a63),volume_type_id=d96ab33c-922e-401a-ac7b-5b8236f59a63)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Creating volume 777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:55:49 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05521cf-c475-4e54-9d32-4043870de7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253f0263-172e-4fed-9870-365c1edf5dff', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4411fad5-5fa6-4e7d-9f33-f3eec0ec7828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:49 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 1073741824 Sep 05 20:55:49 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:49 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Volume volume-253f0263-172e-4fed-9870-365c1edf5dff (253f0263-172e-4fed-9870-365c1edf5dff): created successfully Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4411fad5-5fa6-4e7d-9f33-f3eec0ec7828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Flow 'volume_create_manager' (d6273d90-71c7-4df0-bf01-f64eee768a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:49 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c4f355d2-342c-4b59-a08f-0159ba181555 tempest-VolumesTransfersV357Test-1087543619 None] Created volume successfully. Sep 05 20:55:49 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 1073741824" returned: 0 in 0.539s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:49 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 Sep 05 20:55:49 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:50 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1" returned: 0 in 0.311s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7d6234-501e-463d-a652-1f5a99839cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777e297b-9878-4c18-a02c-76cbc364ece1', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008ca443-dc49-4e4d-8ae4-ebd8578571d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:50 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Volume volume-777e297b-9878-4c18-a02c-76cbc364ece1 (777e297b-9878-4c18-a02c-76cbc364ece1): created successfully Sep 05 20:55:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008ca443-dc49-4e4d-8ae4-ebd8578571d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Flow 'volume_create_manager' (d00904ff-1062-48b2-8e23-5f6f80651f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f881c84b-14b0-4ede-9a7f-5897f5019921 tempest-GroupSnapshotsTest-1928087038 None] Created volume successfully. Sep 05 20:55:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-72931044-544c-417a-82f5-761329d79fd2 tempest-VolumesTransfersV357Test-507296425 None] Transfer volume completed successfully. Sep 05 20:55:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] GroupSnapshot 4eeefa4c-15be-4eaf-8fd1-e3119069dd3e: creating. Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Group snapshot 4eeefa4c-15be-4eaf-8fd1-e3119069dd3e: creating. {{(pid=87778) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Creating offline snapshot 8bc98477-65b4-4167-af48-bd475283a7fd of volume 777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775db1a-724f-4f09-ad0b-96904240ecb6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:51 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 Sep 05 20:55:51 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Acquiring lock "cinder-253f0263-172e-4fed-9870-365c1edf5dff-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-253f0263-172e-4fed-9870-365c1edf5dff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Acquiring lock "cinder-quobyte-253f0263-172e-4fed-9870-365c1edf5dff" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-quobyte-253f0263-172e-4fed-9870-365c1edf5dff" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5e01f9-1444-4250-ad35-f0e5b3b09fb8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1" returned: 0 in 0.476s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd 1G Sep 05 20:55:52 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:52 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff Sep 05 20:55:52 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:52 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff" returned: 0 in 0.480s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff Sep 05 20:55:52 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:52 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd 1G" returned: 0 in 0.507s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777e297b-9878-4c18-a02c-76cbc364ece1 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777e297b-9878-4c18-a02c-76cbc364ece1 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd Sep 05 20:55:52 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:52 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-253f0263-172e-4fed-9870-365c1edf5dff" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-quobyte-253f0263-172e-4fed-9870-365c1edf5dff" released by "delete_volume" :: held 0.856s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Created reservations ['c6286382-eca2-4d88-9a98-00f132677048', '54a10af7-4405-4b2e-a2d2-096bde5e3103', '8ef4af0f-fa4d-448f-958a-31ec02ca1de8', '231dc1b9-9b9c-4e20-bda8-eba1e96c552a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:52 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-777e297b-9878-4c18-a02c-76cbc364ece1 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd" returned: 0 in 0.368s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:52 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:52 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd Sep 05 20:55:52 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:53 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:53 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd" returned: 0 in 0.330s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:53 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.info Sep 05 20:55:53 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.427s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Deleted volume successfully. Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f893e451-3b5c-40bd-a396-ed95612420d5 tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-253f0263-172e-4fed-9870-365c1edf5dff-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:53 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.info" returned: 0 in 0.515s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:53 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:53 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.info Sep 05 20:55:53 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Flow 'volume_create_manager' (7e052373-ff30-4b25-99d9-7f5f165731cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf8bf91-0b2b-4e24-8714-c3e8504212c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf8bf91-0b2b-4e24-8714-c3e8504212c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1019395564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e5f6c7-559a-47b0-b5ac-c181eeee3eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348eb2c35b64add83332f9236b57763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:54Z,use_quota=True,user_id='52579266315b4a92873ced9e24033908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa12ba72-ce06-4179-871e-09aae6858111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa12ba72-ce06-4179-871e-09aae6858111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0445d83d-71b2-4e65-b017-825145d1de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0445d83d-71b2-4e65-b017-825145d1de04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1e5f6c7-559a-47b0-b5ac-c181eeee3eae', 'volume_name': 'volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07aa844b-a765-4d5b-aadc-d0a700c2fb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07aa844b-a765-4d5b-aadc-d0a700c2fb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a93162e-9bcc-4f4e-b870-d99f626a83c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:54 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Volume b1e5f6c7-559a-47b0-b5ac-c181eeee3eae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae', 'volume_size': 1} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:54 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.info" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.602s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1019395564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1e5f6c7-559a-47b0-b5ac-c181eeee3eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9348eb2c35b64add83332f9236b57763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:55:54Z,use_quota=True,user_id='52579266315b4a92873ced9e24033908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Creating volume b1e5f6c7-559a-47b0-b5ac-c181eeee3eae {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:55:54 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:54 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae 1073741824 Sep 05 20:55:54 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-547788cf-04ca-4a39-b9f6-89bce02c8b5b tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 4eeefa4c-15be-4eaf-8fd1-e3119069dd3e: created successfully Sep 05 20:55:54 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae 1073741824" returned: 0 in 0.528s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:54 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae Sep 05 20:55:54 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 4eeefa4c-15be-4eaf-8fd1-e3119069dd3e: deleting Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 4eeefa4c-15be-4eaf-8fd1-e3119069dd3e: deleting {{(pid=87778) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-777e297b-9878-4c18-a02c-76cbc364ece1" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-777e297b-9878-4c18-a02c-76cbc364ece1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-8bc98477-65b4-4167-af48-bd475283a7fd" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-8bc98477-65b4-4167-af48-bd475283a7fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Deleting offline snapshot 8bc98477-65b4-4167-af48-bd475283a7fd of volume 777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] snapshot_file for this snap is: volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:55:55 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a93162e-9bcc-4f4e-b870-d99f626a83c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d2e377-24b3-4b4c-bbbc-31b6b202d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47185f0-8302-4635-9e0a-75b247792e44]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:55 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Volume volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae (b1e5f6c7-559a-47b0-b5ac-c181eeee3eae): created successfully Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d2e377-24b3-4b4c-bbbc-31b6b202d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Flow 'volume_create_manager' (7e052373-ff30-4b25-99d9-7f5f165731cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:55:55 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-108c74db-3194-4c18-9fa5-bb4f33e67c7f tempest-VolumesTransfersV357Test-1087543619 None] Created volume successfully. Sep 05 20:55:55 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd Sep 05 20:55:55 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:55 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd" returned: 0 in 0.410s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-777e297b-9878-4c18-a02c-76cbc364ece1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f7296c-4750-4a8f-9173-9f16cd749cf8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:55 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 Sep 05 20:55:55 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:55 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1" returned: 0 in 0.472s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:56 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd Sep 05 20:55:56 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Acquiring lock "cinder-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:56 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Acquiring lock "cinder-quobyte-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd" returned: 0 in 0.518s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-quobyte-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae" acquired by "delete_volume" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:56 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd Sep 05 20:55:56 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36f8cef-0a80-4738-a3eb-2e81486eef7e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:56 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae Sep 05 20:55:56 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:56 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1.8bc98477-65b4-4167-af48-bd475283a7fd" returned: 0 in 0.311s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-8bc98477-65b4-4167-af48-bd475283a7fd" released by "_delete_snapshot" :: held 1.883s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-777e297b-9878-4c18-a02c-76cbc364ece1" released by "delete_snapshot" :: held 1.916s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:56 devstack cinder-volume[87778]: WARNING cinder.quota [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1122201482 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1122201482, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:56 devstack cinder-volume[87778]: WARNING cinder.quota [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1122201482 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1122201482, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['7fba57db-418c-40a6-a689-2eea5f2bb848', 'c26354b0-82a7-4c08-b5b5-eac0b70d12d1', '15121c7f-45eb-45eb-8fb0-46da6ae11063', 'da75ca36-8b74-4e55-ae1d-537bc3eac590'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:57 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae" returned: 0 in 0.458s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:57 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae Sep 05 20:55:57 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-dbe3bd2e-cc9a-46c4-ae8c-b528bf099769 tempest-GroupSnapshotsTest-1928087038 None] group_snapshot 4eeefa4c-15be-4eaf-8fd1-e3119069dd3e: deleted successfully Sep 05 20:55:57 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae" returned: 0 in 0.299s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-quobyte-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae" released by "delete_volume" :: held 0.819s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=165,cinder:UPDATE=172,cinder:INSERT=51,cinder:DELETE=8 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Created reservations ['49841897-64e6-4d6a-81a4-62d08f7ec32e', '8de60da8-9baa-4f12-9644-9be7596f1e8c', '5dda3035-feb8-4c48-8a48-aeb5b0650460', 'aff26a8d-dcb1-4273-8a6e-dd01ca9137c8'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=161,cinder:UPDATE=205,cinder:INSERT=39,cinder:DELETE=9 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:57 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:57 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "cinder-quobyte-777e297b-9878-4c18-a02c-76cbc364ece1" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-777e297b-9878-4c18-a02c-76cbc364ece1" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d50f6a-42c3-4c96-9afd-6e4b920fb2d3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:55:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:57 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 Sep 05 20:55:57 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:58 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.542s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Deleted volume successfully. Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1c35dc89-47ce-45a8-a616-8553ba149d6b tempest-VolumesTransfersV357Test-1092268196 None] Lock "cinder-b1e5f6c7-559a-47b0-b5ac-c181eeee3eae-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:58 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1" returned: 0 in 0.458s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:58 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1 Sep 05 20:55:58 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:58 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-777e297b-9878-4c18-a02c-76cbc364ece1" returned: 0 in 0.277s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Lock "cinder-quobyte-777e297b-9878-4c18-a02c-76cbc364ece1" released by "delete_volume" :: held 0.823s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['a1c1a1e7-a5a0-4dad-acec-fc7aac808d54'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:58 devstack cinder-volume[87778]: WARNING cinder.quota [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1122201482 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1122201482, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Created reservations ['1f835786-86c3-4e5e-806c-0bcc389dd715', 'b354eb8b-ef46-437d-91f5-099cad59908f', 'dbd49d33-91ac-4d08-a8e9-869c9643527a', '6dbf0ddf-0c51-4b31-aad9-a38991968c4d'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:55:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:55:58 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:55:58 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:55:59 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 05 20:55:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.305s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:55:59 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:55:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a48d629f-bd61-4d9f-a441-e5949aa0bc10 tempest-GroupSnapshotsTest-1928087038 None] Delete group completed successfully. Sep 05 20:56:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:56:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:56:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:56:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:04 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:56:04 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:05 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:56:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:56:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:56:08 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:INSERT=4,cinder:UPDATE=18,cinder:SELECT=8,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:56:08 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:56:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-03e54e9b-4a80-4a2b-93a1-05fcc6a206d8 tempest-GroupSnapshotsV319Test-360609309 None] Group tempest-GroupSnapshotsV319Test-Group-114385313: creating Sep 05 20:56:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-03e54e9b-4a80-4a2b-93a1-05fcc6a206d8 tempest-GroupSnapshotsV319Test-360609309 None] Group tempest-GroupSnapshotsV319Test-Group-114385313: created successfully Sep 05 20:56:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-03e54e9b-4a80-4a2b-93a1-05fcc6a206d8 tempest-GroupSnapshotsV319Test-360609309 None] Create group completed successfully. Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Flow 'volume_create_manager' (8769df9e-f583-456a-874e-0cad5eaf6016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ae7a2c-cb48-4329-a3c3-bb54f9b01df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ae7a2c-cb48-4329-a3c3-bb54f9b01df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-539944150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b33fd99b-4832-41e8-82fc-8f764cf1c2eb,host='devstack@QuobyteHD#QuobyteHD',id=52c56d7f-9d8d-46cc-bab6-002ab8fadafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759ee9d616eb41f3bce0b1e71a84cbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:11Z,use_quota=True,user_id='293b6e41d38f428fa95d1ba5b25ed964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc1bb750-c3f8-46b8-a5f2-5337a3682572),volume_type_id=dc1bb750-c3f8-46b8-a5f2-5337a3682572)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f2dab-b123-4c40-94ed-33d7b2d65f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3f2dab-b123-4c40-94ed-33d7b2d65f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec1d71e-7f96-43ee-8a17-e924beeb54b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec1d71e-7f96-43ee-8a17-e924beeb54b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c56d7f-9d8d-46cc-bab6-002ab8fadafc', 'volume_name': 'volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6baac3e-903d-4e75-8e27-0e06a6d793ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6baac3e-903d-4e75-8e27-0e06a6d793ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8232bb41-08c0-4b6c-bcf7-2a700c1188af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Volume 52c56d7f-9d8d-46cc-bab6-002ab8fadafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc', 'volume_size': 1} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b33fd99b-4832-41e8-82fc-8f764cf1c2eb,created_at=2026-09-05T18:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-539944150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b33fd99b-4832-41e8-82fc-8f764cf1c2eb,host='devstack@QuobyteHD#QuobyteHD',id=52c56d7f-9d8d-46cc-bab6-002ab8fadafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='759ee9d616eb41f3bce0b1e71a84cbfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:11Z,use_quota=True,user_id='293b6e41d38f428fa95d1ba5b25ed964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc1bb750-c3f8-46b8-a5f2-5337a3682572),volume_type_id=dc1bb750-c3f8-46b8-a5f2-5337a3682572)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Creating volume 52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:56:11 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:56:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:11 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc 1073741824 Sep 05 20:56:11 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:12 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc 1073741824" returned: 0 in 0.669s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:12 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc Sep 05 20:56:12 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:12 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" returned: 0 in 0.454s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8232bb41-08c0-4b6c-bcf7-2a700c1188af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a977f7a8-f9a6-455b-a64f-265ad4733962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:12 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Volume volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc (52c56d7f-9d8d-46cc-bab6-002ab8fadafc): created successfully Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a977f7a8-f9a6-455b-a64f-265ad4733962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Flow 'volume_create_manager' (8769df9e-f583-456a-874e-0cad5eaf6016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a4ad7258-7430-47c7-9fb5-45b674bbc5dc tempest-GroupSnapshotsV319Test-360609309 None] Created volume successfully. Sep 05 20:56:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] GroupSnapshot 71c33bab-d58c-473a-a788-4cddc760327e: creating. Sep 05 20:56:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Group snapshot 71c33bab-d58c-473a-a788-4cddc760327e: creating. {{(pid=87778) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 05 20:56:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Creating offline snapshot 278b7abe-51a0-4816-8dfe-1f6938729056 of volume 52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:56:14 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e928db0-d45d-4edf-b2a3-21c000feefe3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:14 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc Sep 05 20:56:14 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:14 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" returned: 0 in 0.459s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:15 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 1G Sep 05 20:56:15 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:15 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 1G" returned: 0 in 0.618s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:15 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 Sep 05 20:56:15 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:16 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056" returned: 0 in 0.414s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:16 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:56:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:16 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 Sep 05 20:56:16 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:16 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056" returned: 0 in 0.331s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:16 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.info Sep 05 20:56:16 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:16 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.info" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:16 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.info is being set with open permissions: ugo+rw: NotImplementedError Sep 05 20:56:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:16 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.info Sep 05 20:56:16 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:17 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.info" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3bd8b1c0-1a15-48c6-831c-50c10d618f36 tempest-GroupSnapshotsV319Test-360609309 None] group_snapshot 71c33bab-d58c-473a-a788-4cddc760327e: created successfully Sep 05 20:56:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] group_snapshot 71c33bab-d58c-473a-a788-4cddc760327e: deleting Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] group_snapshot 71c33bab-d58c-473a-a788-4cddc760327e: deleting {{(pid=87778) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Acquiring lock "cinder-quobyte-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Lock "cinder-quobyte-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Acquiring lock "cinder-quobyte-278b7abe-51a0-4816-8dfe-1f6938729056" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Lock "cinder-quobyte-278b7abe-51a0-4816-8dfe-1f6938729056" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Deleting offline snapshot 278b7abe-51a0-4816-8dfe-1f6938729056 of volume 52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] snapshot_file for this snap is: volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ca6f0-154e-49b7-8016-96f1ca89a7e9]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:18 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 Sep 05 20:56:18 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:18 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056" returned: 0 in 0.490s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b9017b-64d8-4450-a15d-bb390cd24ed7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:19 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc Sep 05 20:56:19 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:19 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" returned: 0 in 0.460s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:19 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 Sep 05 20:56:19 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:19 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056" returned: 0 in 0.505s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:19 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056 Sep 05 20:56:19 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:20 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc.278b7abe-51a0-4816-8dfe-1f6938729056" returned: 0 in 0.300s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Lock "cinder-quobyte-278b7abe-51a0-4816-8dfe-1f6938729056" released by "_delete_snapshot" :: held 1.905s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Lock "cinder-quobyte-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" released by "delete_snapshot" :: held 1.940s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:20 devstack cinder-volume[87778]: WARNING cinder.quota [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-91191889 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-91191889, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:56:20 devstack cinder-volume[87778]: WARNING cinder.quota [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-91191889 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-91191889, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:56:20 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] Created reservations ['fbdfc22e-d104-45c3-a0c3-d4b74f9b8c14', 'f7bfec33-3887-4660-b787-39db65d3984f', '5acc51e9-267a-48bb-be7b-e00e5adda113', 'b74da908-3695-416f-9cd6-a126ccdb4fac'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0f22739f-8ad3-4317-9830-a13bb7e85e02 tempest-GroupSnapshotsV319Test-360609309 None] group_snapshot 71c33bab-d58c-473a-a788-4cddc760327e: deleted successfully Sep 05 20:56:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Acquiring lock "cinder-quobyte-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Lock "cinder-quobyte-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:21 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae701bd-02cc-4357-9590-346ce556592e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:21 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc Sep 05 20:56:21 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:21 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" returned: 0 in 0.646s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:21 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc Sep 05 20:56:21 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:22 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" returned: 0 in 0.583s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Lock "cinder-quobyte-52c56d7f-9d8d-46cc-bab6-002ab8fadafc" released by "delete_volume" :: held 1.342s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Created reservations ['a645d507-f01d-4ec6-bd66-799e6ad95a44'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:22 devstack cinder-volume[87778]: WARNING cinder.quota [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-91191889 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-91191889, it is now deprecated. Please use the default quota class for default quota. Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Created reservations ['46f68150-3ec4-449d-9ed8-35941e1d2adf', '5235b995-9fa2-40fc-b03a-413dfab45642', '952c0f5c-23fc-4fe2-bfcb-f720f6ec7637', '96aad776-8076-47c7-800f-2a0b114dcf59'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:56:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:23 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:56:23 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:23 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.862s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:23 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a1b493d4-62c0-4a7d-9c51-cfe81c07f240 tempest-GroupSnapshotsV319Test-360609309 None] Delete group completed successfully. Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Flow 'volume_create_manager' (5c5a7d5b-de07-4edf-a363-88d385c8e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29a9b8f-32a7-4ee6-a920-34b1d9a0a4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29a9b8f-32a7-4ee6-a920-34b1d9a0a4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077635258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2adf669-2774-456c-9f57-ef345822539c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafad8069fa94d37b6fce724a3742874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:25Z,use_quota=True,user_id='696c5d7e6f3e47a2a91f25fccaf6bef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfeb6498-dfc5-4560-b48a-5c3bbbdeba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfeb6498-dfc5-4560-b48a-5c3bbbdeba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bee189-386a-4e79-957a-7e1ac41ae127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bee189-386a-4e79-957a-7e1ac41ae127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2adf669-2774-456c-9f57-ef345822539c', 'volume_name': 'volume-d2adf669-2774-456c-9f57-ef345822539c', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ede9863-8291-4c31-a2c4-3eaf3eafd212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ede9863-8291-4c31-a2c4-3eaf3eafd212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2a4c4b-e635-4ed9-89db-9ddb4966bc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:25 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Volume d2adf669-2774-456c-9f57-ef345822539c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2adf669-2774-456c-9f57-ef345822539c', 'volume_size': 1} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2077635258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2adf669-2774-456c-9f57-ef345822539c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eafad8069fa94d37b6fce724a3742874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:25Z,use_quota=True,user_id='696c5d7e6f3e47a2a91f25fccaf6bef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Creating volume d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:56:25 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:56:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:26 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c 1073741824 Sep 05 20:56:26 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:27 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c 1073741824" returned: 0 in 1.237s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:27 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:56:27 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:27 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.658s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e2a4c4b-e635-4ed9-89db-9ddb4966bc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2adf669-2774-456c-9f57-ef345822539c', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa97a9a6-4c8a-44f7-afcb-2968ecfd177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:27 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Volume volume-d2adf669-2774-456c-9f57-ef345822539c (d2adf669-2774-456c-9f57-ef345822539c): created successfully Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa97a9a6-4c8a-44f7-afcb-2968ecfd177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Flow 'volume_create_manager' (5c5a7d5b-de07-4edf-a363-88d385c8e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ccd1b1ba-2070-46f6-97ad-5cfb3ff52312 tempest-VolumesActionsTest-842641168 None] Created volume successfully. Sep 05 20:56:37 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:56:37 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=27,cinder:SELECT=29,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Flow 'volume_create_manager' (175a8aa7-e103-4939-b3aa-37e18cb962a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d209f6c3-94c9-4fe5-baed-503203eef1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d209f6c3-94c9-4fe5-baed-503203eef1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-656185279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d056962b-7822-4f4c-84dd-aa96c036f406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9bf86bc1544272a566ed652cd3f524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:40Z,use_quota=True,user_id='f3e4a17295084a59b7cab3035550e9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab40dbdd-7598-4cbe-8182-235ccd5da192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab40dbdd-7598-4cbe-8182-235ccd5da192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b48663d-0a80-4edf-a16b-7a9fb830a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b48663d-0a80-4edf-a16b-7a9fb830a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd056962b-7822-4f4c-84dd-aa96c036f406', 'volume_name': 'volume-d056962b-7822-4f4c-84dd-aa96c036f406', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b8a64-d44c-4b50-89d2-821b1a4698f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896b8a64-d44c-4b50-89d2-821b1a4698f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8270ad-4708-4a8f-98c8-f5e0ecdd3a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:39 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Volume d056962b-7822-4f4c-84dd-aa96c036f406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d056962b-7822-4f4c-84dd-aa96c036f406', 'volume_size': 1} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-656185279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d056962b-7822-4f4c-84dd-aa96c036f406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9bf86bc1544272a566ed652cd3f524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:40Z,use_quota=True,user_id='f3e4a17295084a59b7cab3035550e9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Creating volume d056962b-7822-4f4c-84dd-aa96c036f406 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:56:39 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:39 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:56:39 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 1073741824 Sep 05 20:56:39 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Flow 'volume_create_manager' (99afdbc1-d0b7-42c0-a56f-ef465c5a39e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5881aa-9de7-425a-8fd6-b8534daadea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f5881aa-9de7-425a-8fd6-b8534daadea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1326328832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f2de7a-854e-4333-b92a-ce5ac5d8c186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591ea9893bb24d28a5e7077ca900fbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:40Z,use_quota=True,user_id='c7f36479fc1e45aea629a053df090bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef49ee55-d515-4b20-acbb-4b46d155e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef49ee55-d515-4b20-acbb-4b46d155e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b43ab7-e7bb-42d2-8530-2b795ece7335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b43ab7-e7bb-42d2-8530-2b795ece7335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f2de7a-854e-4333-b92a-ce5ac5d8c186', 'volume_name': 'volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c205f60b-0a49-4333-b236-517f05d3e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c205f60b-0a49-4333-b236-517f05d3e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2f63ba-ac24-487e-83ce-64b584204f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186', 'volume_size': 1} Sep 05 20:56:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:41 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 1073741824" returned: 0 in 1.207s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:41 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 Sep 05 20:56:41 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:41 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406" returned: 0 in 0.593s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1326328832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f2de7a-854e-4333-b92a-ce5ac5d8c186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591ea9893bb24d28a5e7077ca900fbca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:56:40Z,use_quota=True,user_id='c7f36479fc1e45aea629a053df090bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Creating volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:56:41 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8270ad-4708-4a8f-98c8-f5e0ecdd3a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d056962b-7822-4f4c-84dd-aa96c036f406', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a8903a-6a69-404c-8290-ed386bc0787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:41 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 1073741824 Sep 05 20:56:41 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Volume volume-d056962b-7822-4f4c-84dd-aa96c036f406 (d056962b-7822-4f4c-84dd-aa96c036f406): created successfully Sep 05 20:56:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a8903a-6a69-404c-8290-ed386bc0787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Flow 'volume_create_manager' (175a8aa7-e103-4939-b3aa-37e18cb962a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1d7a273c-2966-479f-8bc4-100ced574098 tempest-ServerRescueNegativeTestJSON-1476907106 None] Created volume successfully. Sep 05 20:56:42 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 1073741824" returned: 0 in 0.938s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:42 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 Sep 05 20:56:42 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:43 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186" returned: 0 in 0.499s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:56:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2f63ba-ac24-487e-83ce-64b584204f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9598a3ba-f450-4011-9710-f1785babc6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:56:43 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Volume volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 (43f2de7a-854e-4333-b92a-ce5ac5d8c186): created successfully Sep 05 20:56:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9598a3ba-f450-4011-9710-f1785babc6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:56:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Flow 'volume_create_manager' (99afdbc1-d0b7-42c0-a56f-ef465c5a39e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:56:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-af204e22-de5b-4bd3-8117-7e7ebb8fb5cf tempest-SnapshotsActionsTest-1365078760 None] Created volume successfully. Sep 05 20:56:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Creating offline snapshot 90de3c60-7e7c-436a-9e84-3902a6486e24 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:56:44 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f226aa-7222-42a3-b932-e13c4d56e080]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:44 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 Sep 05 20:56:44 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:45 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186" returned: 0 in 0.777s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:45 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 1G Sep 05 20:56:45 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-574c96f4-2d53-4a45-855f-b60f037b7eca tempest-VolumesActionsTest-842641168 None] Acquiring lock "cinder-d2adf669-2774-456c-9f57-ef345822539c" by "attach_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-574c96f4-2d53-4a45-855f-b60f037b7eca tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c" acquired by "attach_volume" :: waited 0.044s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-574c96f4-2d53-4a45-855f-b60f037b7eca tempest-VolumesActionsTest-842641168 None] Attaching volume d2adf669-2774-456c-9f57-ef345822539c to instance 4837f7bc-ce3e-46ce-9fb1-fb95ebbaebb6 at mountpoint /dev/vdb on host None. Sep 05 20:56:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-574c96f4-2d53-4a45-855f-b60f037b7eca tempest-VolumesActionsTest-842641168 None] Attach volume completed successfully. Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-574c96f4-2d53-4a45-855f-b60f037b7eca tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c" released by "attach_volume" :: held 0.220s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:46 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 1G" returned: 0 in 0.893s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:46 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:56:46 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0d3a3fd1-2541-4ac4-83fe-0822b22117e4 tempest-VolumesActionsTest-842641168 None] Acquiring lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-detach_volume" by "detach_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0d3a3fd1-2541-4ac4-83fe-0822b22117e4 tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0d3a3fd1-2541-4ac4-83fe-0822b22117e4 tempest-VolumesActionsTest-842641168 None] Detaching volume d2adf669-2774-456c-9f57-ef345822539c from instance 4837f7bc-ce3e-46ce-9fb1-fb95ebbaebb6. Sep 05 20:56:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0d3a3fd1-2541-4ac4-83fe-0822b22117e4 tempest-VolumesActionsTest-842641168 None] Detach volume completed successfully. Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0d3a3fd1-2541-4ac4-83fe-0822b22117e4 tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-detach_volume" released by "detach_volume" :: held 0.177s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:46 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.546s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:46 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 is being set with open permissions: ugo+rw Sep 05 20:56:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:46 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:56:46 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:47 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.459s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:47 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.info Sep 05 20:56:47 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:47 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.info" returned: 0 in 0.594s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:47 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.info is being set with open permissions: ugo+rw Sep 05 20:56:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:47 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.info Sep 05 20:56:47 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:48 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.info" returned: 0 in 0.714s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.174s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e2f15578-a4ac-4360-aa91-9727d1ce38eb tempest-SnapshotsActionsTest-1365078760 None] Create snapshot completed successfully Sep 05 20:56:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Creating offline snapshot ee46f5d6-e4f9-4039-9871-b805c0599c37 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:56:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c698de-0bcb-4f9d-905b-54e3bcd5303b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:50 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:56:50 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:51 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.760s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:56:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:51 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 1G Sep 05 20:56:51 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:51 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 1G" returned: 0 in 0.736s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:52 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 Sep 05 20:56:52 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:52 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37" returned: 0 in 0.369s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:52 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 is being set with open permissions: ugo+rw Sep 05 20:56:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:52 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 Sep 05 20:56:52 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:52 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37" returned: 0 in 0.285s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c2977cf9-d539-4f1e-a3b4-c06812d82a6a tempest-SnapshotsActionsTest-1365078760 None] Create snapshot completed successfully Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-ee46f5d6-e4f9-4039-9871-b805c0599c37-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-ee46f5d6-e4f9-4039-9871-b805c0599c37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-ee46f5d6-e4f9-4039-9871-b805c0599c37" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-ee46f5d6-e4f9-4039-9871-b805c0599c37" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Deleting offline snapshot ee46f5d6-e4f9-4039-9871-b805c0599c37 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] snapshot_file for this snap is: volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b6d12-cafe-47b8-a6e2-ae62cc74b126]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:54 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 Sep 05 20:56:54 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Acquiring lock "cinder-d056962b-7822-4f4c-84dd-aa96c036f406-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "cinder-d056962b-7822-4f4c-84dd-aa96c036f406-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Acquiring lock "cinder-quobyte-d056962b-7822-4f4c-84dd-aa96c036f406" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "cinder-quobyte-d056962b-7822-4f4c-84dd-aa96c036f406" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[532d30a2-9323-49db-b969-36e0eed979d4]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:54 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37" returned: 0 in 0.600s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:56:54 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 Sep 05 20:56:54 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[098a4e50-c565-48d8-9dbe-3eccfbb11a2e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:54 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:56:54 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:55 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406" returned: 0 in 0.824s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:55 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406 Sep 05 20:56:55 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:55 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.692s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:55 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 Sep 05 20:56:55 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:55 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d056962b-7822-4f4c-84dd-aa96c036f406" returned: 0 in 0.434s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "cinder-quobyte-d056962b-7822-4f4c-84dd-aa96c036f406" released by "delete_volume" :: held 1.340s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Created reservations ['05d4182f-a836-4a08-bd4a-b688c8214acb', '77685a3b-e111-4c54-a9e4-5286971aa62d', 'bf06dbde-29a3-4ab2-9757-d35074eb726d', '9b32c4fa-67e0-428e-b27e-6c70f71423b7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:55 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37" returned: 0 in 0.710s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:55 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:56:55 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:55 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37 Sep 05 20:56:55 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:56 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:56:56 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Deleted volume successfully. Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cd699201-8527-4d52-90f3-e2dcc61be28a tempest-ServerRescueNegativeTestJSON-1476907106 None] Lock "cinder-d056962b-7822-4f4c-84dd-aa96c036f406-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:56 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.ee46f5d6-e4f9-4039-9871-b805c0599c37" returned: 0 in 0.519s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-ee46f5d6-e4f9-4039-9871-b805c0599c37" released by "_delete_snapshot" :: held 2.751s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" released by "delete_snapshot" :: held 2.794s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Created reservations ['78655fec-53e3-4c1c-b2c8-4c7b1d3a1752', 'b129f231-18a4-49c3-b722-670948530303', '2daa40a8-8457-4b4c-a461-5d3cfbcdd268', '4e0ba8fc-60ca-4bed-b315-991a246b6f7f'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:56:56 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Delete snapshot completed successfully. Sep 05 20:56:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-020a64e4-3483-4315-9e9d-7614f235df8d tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-ee46f5d6-e4f9-4039-9871-b805c0599c37-delete_snapshot" released by "delete_snapshot" :: held 3.112s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:56:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:56:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:56:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Creating offline snapshot 0e157cac-0f57-46b0-aa28-eaab6ddf0394 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:56:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbdb5d8-8aea-43be-8ad3-6241cde9c37e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:56:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:57 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:56:57 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:58 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.598s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:56:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:58 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 1G Sep 05 20:56:58 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:59 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 1G" returned: 0 in 0.879s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:56:59 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 Sep 05 20:56:59 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:56:59 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 05 20:56:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394" returned: 0 in 0.636s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:56:59 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 is being set with open permissions: ugo+rw Sep 05 20:56:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:00 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 Sep 05 20:57:00 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:00 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394" returned: 0 in 1.008s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f0863013-ef78-4f87-af18-79f7a52a41d8 tempest-SnapshotsActionsTest-1365078760 None] Create snapshot completed successfully Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-0e157cac-0f57-46b0-aa28-eaab6ddf0394-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-0e157cac-0f57-46b0-aa28-eaab6ddf0394-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-0e157cac-0f57-46b0-aa28-eaab6ddf0394" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-0e157cac-0f57-46b0-aa28-eaab6ddf0394" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Deleting offline snapshot 0e157cac-0f57-46b0-aa28-eaab6ddf0394 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] snapshot_file for this snap is: volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf66c4c-d765-4e9d-9766-b5152d6d5f2b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:02 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 Sep 05 20:57:02 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:03 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394" returned: 0 in 0.654s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:03 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1382122b-2868-4984-9fb9-687b2f2fda59]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:03 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:03 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:03 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.479s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:03 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 Sep 05 20:57:03 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:04 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394" returned: 0 in 0.476s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:04 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394 Sep 05 20:57:04 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83cc8d17-0d4a-44b6-9710-91c4b501b08b tempest-VolumesActionsTest-842641168 None] Acquiring lock "cinder-d2adf669-2774-456c-9f57-ef345822539c" by "attach_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83cc8d17-0d4a-44b6-9710-91c4b501b08b tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c" acquired by "attach_volume" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-83cc8d17-0d4a-44b6-9710-91c4b501b08b tempest-VolumesActionsTest-842641168 None] Attaching volume d2adf669-2774-456c-9f57-ef345822539c to instance a05273c1-5404-41ec-a065-52af036f2c13 at mountpoint /dev/vdb on host None. Sep 05 20:57:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-83cc8d17-0d4a-44b6-9710-91c4b501b08b tempest-VolumesActionsTest-842641168 None] Attach volume completed successfully. Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83cc8d17-0d4a-44b6-9710-91c4b501b08b tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c" released by "attach_volume" :: held 0.180s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:04 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.0e157cac-0f57-46b0-aa28-eaab6ddf0394" returned: 0 in 0.376s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-0e157cac-0f57-46b0-aa28-eaab6ddf0394" released by "_delete_snapshot" :: held 2.184s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" released by "delete_snapshot" :: held 2.218s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Created reservations ['0d48bc60-1091-4082-9b9c-ebee188b403c', '1e1f0ffa-a0bf-4f43-b9bf-e4cf5331f1fb', 'a7590472-88a0-4045-835c-743839f4e837', '285b67b2-e724-44ed-adb8-2eee5c28ee5a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Delete snapshot completed successfully. Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9a769ed2-41b8-46b5-a46f-1c752b15fa92 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-0e157cac-0f57-46b0-aa28-eaab6ddf0394-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d5b452a3-6283-4194-b892-f5ff83997ff5 tempest-VolumesActionsTest-842641168 None] Acquiring lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-detach_volume" by "detach_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:04 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:57:04 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d5b452a3-6283-4194-b892-f5ff83997ff5 tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d5b452a3-6283-4194-b892-f5ff83997ff5 tempest-VolumesActionsTest-842641168 None] Detaching volume d2adf669-2774-456c-9f57-ef345822539c from instance a05273c1-5404-41ec-a065-52af036f2c13. Sep 05 20:57:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d5b452a3-6283-4194-b892-f5ff83997ff5 tempest-VolumesActionsTest-842641168 None] Detach volume completed successfully. Sep 05 20:57:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d5b452a3-6283-4194-b892-f5ff83997ff5 tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-detach_volume" released by "detach_volume" :: held 0.190s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:05 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.538s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:57:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:57:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Creating offline snapshot 102b875c-2b4e-4982-9ea8-a32368627d4f of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[16517642-412c-49d4-9f17-315ecfdd7319]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:06 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:06 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:06 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.487s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:06 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f 1G Sep 05 20:57:06 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:07 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f 1G" returned: 0 in 0.506s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:07 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f Sep 05 20:57:07 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:07 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f" returned: 0 in 0.362s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:07 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f is being set with open permissions: ugo+rw Sep 05 20:57:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:07 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f Sep 05 20:57:07 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:08 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f" returned: 0 in 0.436s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:08 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e6f4c353-8d01-4e61-9829-214d3b5808d4 tempest-SnapshotsActionsTest-1365078760 None] Create snapshot completed successfully Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-102b875c-2b4e-4982-9ea8-a32368627d4f-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-102b875c-2b4e-4982-9ea8-a32368627d4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-102b875c-2b4e-4982-9ea8-a32368627d4f" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-102b875c-2b4e-4982-9ea8-a32368627d4f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Deleting offline snapshot 102b875c-2b4e-4982-9ea8-a32368627d4f of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] snapshot_file for this snap is: volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf839d6-9ecb-43e4-921e-9bac64697222]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:09 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f Sep 05 20:57:09 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:10 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f" returned: 0 in 0.469s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff8c9c-8a9a-4995-b5fa-2f7fe219f447]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:10 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:10 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:10 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.413s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:10 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f Sep 05 20:57:10 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:10 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f" returned: 0 in 0.492s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:11 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f Sep 05 20:57:11 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c86c7a4-bc03-4255-a53a-d683e6343c9a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:11 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.102b875c-2b4e-4982-9ea8-a32368627d4f" returned: 0 in 0.270s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-102b875c-2b4e-4982-9ea8-a32368627d4f" released by "_delete_snapshot" :: held 1.832s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:11 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:57:11 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" released by "delete_snapshot" :: held 1.863s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Created reservations ['b14d0c02-62f6-4671-afc4-4d5812dc59ce', 'a1aa1df3-837e-4ad0-b6f6-c7e95f9ad548', '1db2e141-2a50-4754-a564-a31dd21c8e76', 'b1de3d9c-d2aa-4d61-9c6c-c37be1a58419'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Delete snapshot completed successfully. Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6cfca6f8-5b4c-404f-ba70-d5fcc4f80bed tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-102b875c-2b4e-4982-9ea8-a32368627d4f-delete_snapshot" released by "delete_snapshot" :: held 2.037s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:11 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.411s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8beb4-393e-433c-8553-b1623ff15461]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:11 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:57:11 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:12 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.435s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.9ce9b535-a33f-4a63-bfd1-670b2e4deb630_cqsed3.img {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:12 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.9ce9b535-a33f-4a63-bfd1-670b2e4deb630_cqsed3.img Sep 05 20:57:12 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:16 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.9ce9b535-a33f-4a63-bfd1-670b2e4deb630_cqsed3.img" returned: 0 in 4.717s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:16 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce557a1-c874-4ab6-8722-83610b0661ff]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:16 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:57:16 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:17 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.603s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:17 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.9ce9b535-a33f-4a63-bfd1-670b2e4deb630_cqsed3.img {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:57:17 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Converted 1024.00 MB image at 217.05 MB/s Sep 05 20:57:17 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] 9ce9b535-a33f-4a63-bfd1-670b2e4deb63 was raw, no need to convert to raw {{(pid=87778) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 05 20:57:21 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=54,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:57:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:57:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=43,cinder:SELECT=43,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:57:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.347s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Uploaded volume to glance image-id: 9ce9b535-a33f-4a63-bfd1-670b2e4deb63. {{(pid=87778) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 20:57:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 31.526s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Creating offline snapshot d62f2ef3-bf91-47eb-bc10-f5bf81000858 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:57:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-766810fe-4792-45d9-b0f6-58b194e10a4d tempest-VolumesActionsTest-842641168 None] Copy volume to image completed successfully. Sep 05 20:57:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d0eff-98f6-471e-b287-77c40f126c46]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:43 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:43 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:44 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 1.109s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:44 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 1G Sep 05 20:57:44 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:45 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 1G" returned: 0 in 0.966s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:45 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 Sep 05 20:57:45 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:46 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858" returned: 0 in 0.610s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:46 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 is being set with open permissions: ugo+rw Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:46 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 Sep 05 20:57:46 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:46 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858" returned: 0 in 0.499s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.210s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[50df7bf8-4775-40be-9a52-6ae856236be9]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bc4952c1-43c9-4b8b-8369-ece8599d38ae tempest-SnapshotsActionsTest-1365078760 None] Create snapshot completed successfully Sep 05 20:57:47 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:57:47 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-d62f2ef3-bf91-47eb-bc10-f5bf81000858-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-d62f2ef3-bf91-47eb-bc10-f5bf81000858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Acquiring lock "cinder-quobyte-d62f2ef3-bf91-47eb-bc10-f5bf81000858" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-d62f2ef3-bf91-47eb-bc10-f5bf81000858" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Deleting offline snapshot d62f2ef3-bf91-47eb-bc10-f5bf81000858 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] snapshot_file for this snap is: volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea4e9e-4821-46f7-890b-329e36f161b6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:47 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.806s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[175b026f-5a92-46c6-91fd-91a1112c4874]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:47 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 Sep 05 20:57:47 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:48 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:57:48 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:48 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858" returned: 0 in 0.759s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fee2c0-d42a-4b0a-b027-be5bd6f3fa1a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:48 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.780s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:48 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:48 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:48 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img Sep 05 20:57:48 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:48 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.506s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:48 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 Sep 05 20:57:48 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:50 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858" returned: 0 in 1.497s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:50 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858 Sep 05 20:57:50 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:51 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.d62f2ef3-bf91-47eb-bc10-f5bf81000858" returned: 0 in 0.945s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-d62f2ef3-bf91-47eb-bc10-f5bf81000858" released by "_delete_snapshot" :: held 3.931s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" released by "delete_snapshot" :: held 3.985s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:51 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Created reservations ['67a8bf08-fdd0-45af-aa1b-cc3f4a94252d', '412c27a2-9ec0-47e4-bbef-998f9a0a4a94', 'd816e3f8-e599-42ea-8f2b-accdc94f3a52', '63a99966-89b2-4cef-b792-e95525c29202'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Delete snapshot completed successfully. Sep 05 20:57:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6148418c-b43d-42ec-aa00-48a4dc7291a3 tempest-SnapshotsActionsTest-1792813990 None] Lock "cinder-d62f2ef3-bf91-47eb-bc10-f5bf81000858-delete_snapshot" released by "delete_snapshot" :: held 4.447s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "cinder-90de3c60-7e7c-436a-9e84-3902a6486e24-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-90de3c60-7e7c-436a-9e84-3902a6486e24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "cinder-quobyte-90de3c60-7e7c-436a-9e84-3902a6486e24" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-quobyte-90de3c60-7e7c-436a-9e84-3902a6486e24" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Deleting offline snapshot 90de3c60-7e7c-436a-9e84-3902a6486e24 of volume 43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] snapshot_file for this snap is: volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[85621613-2a65-46b9-a84f-97f9080490bb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:54 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:54 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:54 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img" returned: 0 in 6.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fb3dcd-724d-4aa6-ad5a-635e524c7e2d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:57:54 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Flow 'volume_create_manager' (731cd6c8-6dc0-4e47-9d57-d9633ae61621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94547bb-b83a-4c30-9e37-d2bb4b3f5dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.762s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94547bb-b83a-4c30-9e37-d2bb4b3f5dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1990971573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b6d5cd-7051-4b71-80f5-0aba2c1efd1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427e0ac766b445e191dc8224e04335f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:55Z,use_quota=True,user_id='46dbd29a5fd44e1695ac9bf5c50388e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:55 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:57:55 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7452f21-4d39-46ef-8c8a-ad294309be94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7452f21-4d39-46ef-8c8a-ad294309be94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f05793a-6cce-4850-8f6b-41cbf8779055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f05793a-6cce-4850-8f6b-41cbf8779055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b6d5cd-7051-4b71-80f5-0aba2c1efd1f', 'volume_name': 'volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f14131d-bbc2-4b65-ba1a-0f01ea6157e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f14131d-bbc2-4b65-ba1a-0f01ea6157e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95123f5-bd59-428e-8039-7445dc341d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:55 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Volume 19b6d5cd-7051-4b71-80f5-0aba2c1efd1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f', 'volume_size': 1} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadceea9-04ff-4dca-8877-5038364ff90a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 Sep 05 20:57:55 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.563s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:57:55 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Converted 1024.00 MB image at 161.87 MB/s Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5 was raw, converting to qcow2 {{(pid=87778) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 05 20:57:55 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186" returned: 0 in 0.412s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b606012-63a6-4e95-a2d0-a28dd3b9c0c1]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:55 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img Sep 05 20:57:55 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:55 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.483s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:55 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24 Sep 05 20:57:55 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:56 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img Sep 05 20:57:56 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:56 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img" returned: 1 in 0.384s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img /opt/stack/data/cinder/conversion/vol_upload_ceqhwdob {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:56 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186.90de3c60-7e7c-436a-9e84-3902a6486e24" returned: 0 in 0.334s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img /opt/stack/data/cinder/conversion/vol_upload_ceqhwdob Sep 05 20:57:56 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-quobyte-90de3c60-7e7c-436a-9e84-3902a6486e24" released by "_delete_snapshot" :: held 2.269s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" released by "delete_snapshot" :: held 2.332s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Created reservations ['df2c4b5a-ac72-48e6-8d88-1b18767ec3b7', '5da9c877-4729-40e0-a104-3dfdad600629', 'c3da14ba-d48a-42f9-9cd3-3defca76aa45', 'ecd3356d-5f5b-4df0-a0a3-f1bf4ef37752'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:56 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Delete snapshot completed successfully. Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2131fcb-bf6b-44d8-b0f5-609edfccfc73 tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-90de3c60-7e7c-436a-9e84-3902a6486e24-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:56 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img /opt/stack/data/cinder/conversion/vol_upload_ceqhwdob" returned: 0 in 0.354s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Image conversion details: src /opt/stack/data/cinder/conversion/d2adf669-2774-456c-9f57-ef345822539c.temp_image.b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5wu778fti.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ceqhwdob {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:57:56 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b439e-245e-47a3-994c-05d44fe31083]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ceqhwdob {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:56 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ceqhwdob Sep 05 20:57:56 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:57 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ceqhwdob" returned: 0 in 0.424s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "cinder-43f2de7a-854e-4333-b92a-ce5ac5d8c186-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-43f2de7a-854e-4333-b92a-ce5ac5d8c186-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a060b65-a961-4ec8-81ad-44eabf98b568]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:57 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 Sep 05 20:57:57 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:57 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186" returned: 0 in 0.493s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:57 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186 Sep 05 20:57:58 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:58 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-43f2de7a-854e-4333-b92a-ce5ac5d8c186" returned: 0 in 0.271s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-quobyte-43f2de7a-854e-4333-b92a-ce5ac5d8c186" released by "delete_volume" :: held 0.854s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Created reservations ['c066ccd2-6248-4819-af37-d2f9e87c8b84', 'de879e55-c9bf-4242-b142-5b46891ba0bd', '5bfec942-065b-4bbb-a6d2-f31156eab55d', '4ee281c0-fbcf-4cfc-9215-ca8c7af1494e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:58 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:57:58 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:58 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.333s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:57:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Deleted volume successfully. Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0c375c89-69ee-4624-bd8a-d17bace6adbc tempest-SnapshotsActionsTest-1365078760 None] Lock "cinder-43f2de7a-854e-4333-b92a-ce5ac5d8c186-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.025s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Uploaded volume to glance image-id: b7e8c5f2-fe61-4c2b-9459-95e7a16d43f5. {{(pid=87778) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.843s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1990971573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b6d5cd-7051-4b71-80f5-0aba2c1efd1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427e0ac766b445e191dc8224e04335f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:57:55Z,use_quota=True,user_id='46dbd29a5fd44e1695ac9bf5c50388e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Creating volume 19b6d5cd-7051-4b71-80f5-0aba2c1efd1f {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:57:58 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:57:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:58 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f 1073741824 Sep 05 20:57:58 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-91d493dd-8356-4748-863d-b03b11990be5 tempest-VolumesActionsTest-842641168 None] Copy volume to image completed successfully. Sep 05 20:57:59 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f 1073741824" returned: 0 in 0.517s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:57:59 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f Sep 05 20:57:59 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:57:59 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f" returned: 0 in 0.307s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95123f5-bd59-428e-8039-7445dc341d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79746fac-4748-45da-a6e6-9f7eaf152fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:57:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Volume volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f (19b6d5cd-7051-4b71-80f5-0aba2c1efd1f): created successfully Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79746fac-4748-45da-a6e6-9f7eaf152fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:57:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Flow 'volume_create_manager' (731cd6c8-6dc0-4e47-9d57-d9633ae61621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:57:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fc95bcd4-35e6-4f53-a239-d0a7fa23beab tempest-ServersNegativeTestJSON-1911668305 None] Created volume successfully. Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Acquiring lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Acquiring lock "cinder-quobyte-d2adf669-2774-456c-9f57-ef345822539c" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Lock "cinder-quobyte-d2adf669-2774-456c-9f57-ef345822539c" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f8c0cd-3a3b-4e76-80f7-dd3362243530]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:00 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:58:00 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:00 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:00 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c Sep 05 20:58:00 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:01 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2adf669-2774-456c-9f57-ef345822539c" returned: 0 in 0.297s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Lock "cinder-quobyte-d2adf669-2774-456c-9f57-ef345822539c" released by "delete_volume" :: held 0.801s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Created reservations ['30585e55-be5e-49be-ae90-359c220e34db', '8db86b01-ebff-4ef7-a738-19efd75ed70e', '1596c1ba-ec86-40f5-851b-9ae3926c5cfc', '3ad98e2f-7b8f-48db-920e-b472d7fd0957'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:01 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:01 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:01 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.502s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Deleted volume successfully. Sep 05 20:58:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-32013b7e-c1e8-4d0b-a083-d484080c7048 tempest-VolumesActionsTest-842641168 None] Lock "cinder-d2adf669-2774-456c-9f57-ef345822539c-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Flow 'volume_create_manager' (433d20b5-2efa-42c7-a4e2-1b93c6bb1b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aad9a4f-953e-44f1-b78d-944a1a4f84be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aad9a4f-953e-44f1-b78d-944a1a4f84be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1784621005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7532628f-783e-42ac-afed-d43225a93bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427e0ac766b445e191dc8224e04335f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:02Z,use_quota=True,user_id='46dbd29a5fd44e1695ac9bf5c50388e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e7bf59-2678-49e4-8aed-b4ae366f4f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e7bf59-2678-49e4-8aed-b4ae366f4f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affce9e7-d4bb-4991-af44-6c00ae130922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affce9e7-d4bb-4991-af44-6c00ae130922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7532628f-783e-42ac-afed-d43225a93bcb', 'volume_name': 'volume-7532628f-783e-42ac-afed-d43225a93bcb', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc149e05-3006-4688-a020-708f536cc202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc149e05-3006-4688-a020-708f536cc202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f73c814-c150-425b-9a6a-d263cfe4d93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Volume 7532628f-783e-42ac-afed-d43225a93bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7532628f-783e-42ac-afed-d43225a93bcb', 'volume_size': 1} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1784621005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7532628f-783e-42ac-afed-d43225a93bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427e0ac766b445e191dc8224e04335f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:02Z,use_quota=True,user_id='46dbd29a5fd44e1695ac9bf5c50388e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Creating volume 7532628f-783e-42ac-afed-d43225a93bcb {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:02 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:02 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb 1073741824 Sep 05 20:58:02 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:03 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb 1073741824" returned: 0 in 0.611s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:03 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb Sep 05 20:58:03 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:03 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f73c814-c150-425b-9a6a-d263cfe4d93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7532628f-783e-42ac-afed-d43225a93bcb', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677743d0-30b4-4164-8fc9-c7c12cfe26b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Volume volume-7532628f-783e-42ac-afed-d43225a93bcb (7532628f-783e-42ac-afed-d43225a93bcb): created successfully Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677743d0-30b4-4164-8fc9-c7c12cfe26b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Flow 'volume_create_manager' (433d20b5-2efa-42c7-a4e2-1b93c6bb1b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3fcd7f93-a83b-4f06-8c94-536f59e014c9 tempest-ServersNegativeTestJSON-1911668305 None] Created volume successfully. Sep 05 20:58:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:58:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:04 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:04 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "cinder-7532628f-783e-42ac-afed-d43225a93bcb-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-7532628f-783e-42ac-afed-d43225a93bcb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "cinder-quobyte-7532628f-783e-42ac-afed-d43225a93bcb" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-quobyte-7532628f-783e-42ac-afed-d43225a93bcb" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b655e3a0-b4e8-4ba2-96d3-a62e44c12731]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:05 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.398s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:58:05 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb Sep 05 20:58:05 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:05 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb" returned: 0 in 0.545s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:05 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb Sep 05 20:58:05 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:06 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7532628f-783e-42ac-afed-d43225a93bcb" returned: 0 in 0.496s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-quobyte-7532628f-783e-42ac-afed-d43225a93bcb" released by "delete_volume" :: held 1.113s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Created reservations ['e92fecd1-f459-439f-a07c-477b382bfefe', 'ccc15de6-d1e9-46f7-8d44-6d9b63e1fa38', '84c12c28-e528-4644-82f1-c03e8e105761', 'd991d305-90e6-4e09-869b-988163279bbe'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:06 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:06 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:06 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.397s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Deleted volume successfully. Sep 05 20:58:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce619545-6f82-48c8-a55a-39d5f9507d25 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-7532628f-783e-42ac-afed-d43225a93bcb-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "cinder-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "cinder-quobyte-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-quobyte-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6150b38-1e36-4694-811e-373ea6376d0b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:07 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f Sep 05 20:58:07 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:08 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f" returned: 0 in 0.535s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:08 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f Sep 05 20:58:08 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:08 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f" returned: 0 in 0.317s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-quobyte-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f" released by "delete_volume" :: held 0.939s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Created reservations ['c5f40b94-e5d1-4125-b4c8-1c2939b94b21', '2b5ea5c1-8453-4185-93a1-64c883c880ac', '09e85b54-8a33-49dc-8865-5a7b337203c1', '382c3ad0-3479-4983-a4b5-32adcfcb030b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:08 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:08 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:09 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.513s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:09 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Deleted volume successfully. Sep 05 20:58:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d64e6c03-41dc-45de-aac7-e2b35fb3b3d5 tempest-ServersNegativeTestJSON-1911668305 None] Lock "cinder-19b6d5cd-7051-4b71-80f5-0aba2c1efd1f-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Flow 'volume_create_manager' (dab62956-9210-4ff6-a9c1-1991eec4b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc5ea1a-7035-499a-9605-89edf2ba3e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc5ea1a-7035-499a-9605-89edf2ba3e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-415579383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f8cb912774a5e9acbbdcdd7c0284d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:17Z,use_quota=True,user_id='0458e4e4569b4e7aaf8b43b6e27055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdbe347-e396-406f-98fd-48c128bd1ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bdbe347-e396-406f-98fd-48c128bd1ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45aa308-b69d-4485-956d-d38930c6960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45aa308-b69d-4485-956d-d38930c6960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9', 'volume_name': 'volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed096931-df50-4b8c-8e32-f59cb3a1b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed096931-df50-4b8c-8e32-f59cb3a1b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add52380-756d-4536-b9f4-7f8f4b25c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:16 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Volume 0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9', 'volume_size': 1} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-415579383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f8cb912774a5e9acbbdcdd7c0284d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:17Z,use_quota=True,user_id='0458e4e4569b4e7aaf8b43b6e27055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Creating volume 0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:16 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:16 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 1073741824 Sep 05 20:58:16 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Flow 'volume_create_manager' (d2319e83-69c7-4c9a-8ce2-1bb3b608bb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394a612d-1b26-422e-a0f0-00d1ca5934c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394a612d-1b26-422e-a0f0-00d1ca5934c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1318451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967f14d4-17e2-4127-af41-d9613d4512c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='778d8e6eb1e24fa5a9c1c03c7c134e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:17Z,use_quota=True,user_id='209a15454ff8402c835c4c3535f4040f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100959b9-7c20-4b85-a090-941ac87c0be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100959b9-7c20-4b85-a090-941ac87c0be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732ee2af-9edd-4354-8349-2f7ab9f6ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732ee2af-9edd-4354-8349-2f7ab9f6ded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967f14d4-17e2-4127-af41-d9613d4512c9', 'volume_name': 'volume-967f14d4-17e2-4127-af41-d9613d4512c9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2af447a-25e9-46e9-b1ee-6493d6ff8576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2af447a-25e9-46e9-b1ee-6493d6ff8576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ea4a86-bf59-41b3-912a-e909633d8343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:17 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Volume 967f14d4-17e2-4127-af41-d9613d4512c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967f14d4-17e2-4127-af41-d9613d4512c9', 'volume_size': 1} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 1073741824" returned: 0 in 0.565s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:17 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 Sep 05 20:58:17 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:17 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1318451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967f14d4-17e2-4127-af41-d9613d4512c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='778d8e6eb1e24fa5a9c1c03c7c134e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:17Z,use_quota=True,user_id='209a15454ff8402c835c4c3535f4040f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Creating volume 967f14d4-17e2-4127-af41-d9613d4512c9 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:17 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add52380-756d-4536-b9f4-7f8f4b25c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:17 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 1073741824 Sep 05 20:58:17 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6319c743-00dc-40c1-b30e-eb2df65cb01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Volume volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 (0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9): created successfully Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6319c743-00dc-40c1-b30e-eb2df65cb01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Flow 'volume_create_manager' (dab62956-9210-4ff6-a9c1-1991eec4b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0a2c2ea1-f3b5-448e-a55e-f2a4be561af2 tempest-VolumeQuotasAdminTestJSON-458592273 None] Created volume successfully. Sep 05 20:58:18 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 1073741824" returned: 0 in 0.554s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:18 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 Sep 05 20:58:18 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:18 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9" returned: 0 in 0.285s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ea4a86-bf59-41b3-912a-e909633d8343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967f14d4-17e2-4127-af41-d9613d4512c9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5107f3-8dd0-43ee-8340-d5f9ffce1390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Volume volume-967f14d4-17e2-4127-af41-d9613d4512c9 (967f14d4-17e2-4127-af41-d9613d4512c9): created successfully Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5107f3-8dd0-43ee-8340-d5f9ffce1390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Flow 'volume_create_manager' (d2319e83-69c7-4c9a-8ce2-1bb3b608bb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-03f37fac-c6e5-4ff9-a1f3-84cd90339969 tempest-VolumesListTestJSON-342608604 None] Created volume successfully. Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Acquiring lock "cinder-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "cinder-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Acquiring lock "cinder-quobyte-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "cinder-quobyte-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:19 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86c6f61-cf83-431f-905b-c688caa0442a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:19 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 Sep 05 20:58:19 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:19 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9" returned: 0 in 0.428s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:19 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9 Sep 05 20:58:19 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:19 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9" returned: 0 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "cinder-quobyte-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9" released by "delete_volume" :: held 0.828s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:19 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Created reservations ['18e404be-c20d-413e-b9ab-4fbd9e97946f', '6c8c1c55-eafe-43b7-a1cf-502a1158fc42', '3f70d5a5-ec77-4aa8-9fad-056af5f247d2', '9fd51b5d-5978-4aed-ad58-67a1e388ce82'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:20 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:20 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Flow 'volume_create_manager' (c6ec33e3-05ee-4c8f-9b11-7f63ff103749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c83981f-4435-4502-9885-143cc6ac9463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c83981f-4435-4502-9885-143cc6ac9463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1321861684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fdaf30-5814-4e58-922b-d4b37c3b0398,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='778d8e6eb1e24fa5a9c1c03c7c134e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:20Z,use_quota=True,user_id='209a15454ff8402c835c4c3535f4040f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a8d903-60c7-452c-8aef-e557bd1ca079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a8d903-60c7-452c-8aef-e557bd1ca079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191f2104-8e5a-49a4-b440-26d1369fa7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191f2104-8e5a-49a4-b440-26d1369fa7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fdaf30-5814-4e58-922b-d4b37c3b0398', 'volume_name': 'volume-23fdaf30-5814-4e58-922b-d4b37c3b0398', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ec695c-9813-466b-86e8-ba664cd46ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ec695c-9813-466b-86e8-ba664cd46ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d616e10-4edb-4d9b-8997-5a220d744b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Volume 23fdaf30-5814-4e58-922b-d4b37c3b0398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fdaf30-5814-4e58-922b-d4b37c3b0398', 'volume_size': 1} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1321861684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fdaf30-5814-4e58-922b-d4b37c3b0398,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='778d8e6eb1e24fa5a9c1c03c7c134e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:20Z,use_quota=True,user_id='209a15454ff8402c835c4c3535f4040f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Creating volume 23fdaf30-5814-4e58-922b-d4b37c3b0398 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:20 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:20 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.335s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:20 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 1073741824 Sep 05 20:58:20 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Deleted volume successfully. Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-07c1c877-c7f1-4047-8c5a-d49c9209e0d5 tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "cinder-0ed1a0ac-0a04-4b33-a6f2-9c26b0a908e9-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Flow 'volume_create_manager' (e0ca6c4b-65d6-4be2-aa5a-09cba004c968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac22a5d0-c626-4793-8abe-80a046940def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac22a5d0-c626-4793-8abe-80a046940def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1033345965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3a523d-7a7d-4927-8cee-07828767484a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f8cb912774a5e9acbbdcdd7c0284d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:21Z,use_quota=True,user_id='0458e4e4569b4e7aaf8b43b6e27055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1c706c-d3fa-40a8-aa3e-645eaef8da13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1c706c-d3fa-40a8-aa3e-645eaef8da13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a22771-469a-4755-abec-1acb2cabe170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76a22771-469a-4755-abec-1acb2cabe170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f3a523d-7a7d-4927-8cee-07828767484a', 'volume_name': 'volume-8f3a523d-7a7d-4927-8cee-07828767484a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa39db-e14c-490e-bcaa-7180bfe90329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1aa39db-e14c-490e-bcaa-7180bfe90329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d059e38-ba52-4e8d-b81a-7d520af68932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Volume 8f3a523d-7a7d-4927-8cee-07828767484a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f3a523d-7a7d-4927-8cee-07828767484a', 'volume_size': 1} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:20 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 1073741824" returned: 0 in 0.599s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:21 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 Sep 05 20:58:21 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:21 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1033345965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3a523d-7a7d-4927-8cee-07828767484a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92f8cb912774a5e9acbbdcdd7c0284d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:21Z,use_quota=True,user_id='0458e4e4569b4e7aaf8b43b6e27055e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Creating volume 8f3a523d-7a7d-4927-8cee-07828767484a {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:21 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d616e10-4edb-4d9b-8997-5a220d744b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fdaf30-5814-4e58-922b-d4b37c3b0398', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cffede0-e681-4f99-b518-5d4091dbc4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:21 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a 1073741824 Sep 05 20:58:21 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:21 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Volume volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 (23fdaf30-5814-4e58-922b-d4b37c3b0398): created successfully Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cffede0-e681-4f99-b518-5d4091dbc4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Flow 'volume_create_manager' (c6ec33e3-05ee-4c8f-9b11-7f63ff103749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-817bc067-7051-45c6-91a2-4fe6360b5a28 tempest-VolumesListTestJSON-342608604 None] Created volume successfully. Sep 05 20:58:21 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a 1073741824" returned: 0 in 0.579s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:21 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a Sep 05 20:58:21 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:22 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a" returned: 0 in 0.284s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d059e38-ba52-4e8d-b81a-7d520af68932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3a523d-7a7d-4927-8cee-07828767484a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2294eff0-9975-4548-992e-2d80c2e2884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:22 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Volume volume-8f3a523d-7a7d-4927-8cee-07828767484a (8f3a523d-7a7d-4927-8cee-07828767484a): created successfully Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2294eff0-9975-4548-992e-2d80c2e2884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Flow 'volume_create_manager' (e0ca6c4b-65d6-4be2-aa5a-09cba004c968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-edc8e963-5e3c-4ca2-84c8-4e844220f40e tempest-VolumeQuotasAdminTestJSON-458592273 None] Created volume successfully. Sep 05 20:58:22 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Flow 'volume_create_manager' (2af82a7c-0f7b-4beb-b6ca-9a1af202d9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6edea93-3b09-4156-b3a4-75b3b91cbbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6edea93-3b09-4156-b3a4-75b3b91cbbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1101843046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a2cfef-b448-44b3-bce6-94d47bb403b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='778d8e6eb1e24fa5a9c1c03c7c134e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:23Z,use_quota=True,user_id='209a15454ff8402c835c4c3535f4040f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671cbba3-ce96-416a-9df8-54b674b6a6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (671cbba3-ce96-416a-9df8-54b674b6a6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cbafca-b104-45b3-a1a6-9cf71ad9b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cbafca-b104-45b3-a1a6-9cf71ad9b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a2cfef-b448-44b3-bce6-94d47bb403b8', 'volume_name': 'volume-09a2cfef-b448-44b3-bce6-94d47bb403b8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b241b3-8602-4cdd-80aa-b1e06f193646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b241b3-8602-4cdd-80aa-b1e06f193646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548adf9b-dd46-4fe4-b052-587ce3ab96fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:23 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Volume 09a2cfef-b448-44b3-bce6-94d47bb403b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a2cfef-b448-44b3-bce6-94d47bb403b8', 'volume_size': 1} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1101843046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a2cfef-b448-44b3-bce6-94d47bb403b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='778d8e6eb1e24fa5a9c1c03c7c134e14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:23Z,use_quota=True,user_id='209a15454ff8402c835c4c3535f4040f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Creating volume 09a2cfef-b448-44b3-bce6-94d47bb403b8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:23 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:23 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 1073741824 Sep 05 20:58:23 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:23 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 1073741824" returned: 0 in 0.589s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:23 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 Sep 05 20:58:23 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c5617566-dbfe-4eab-a679-0b2c7fe2f8fe tempest-VolumeQuotasAdminTestJSON-725581195 None] Transfer volume completed successfully. Sep 05 20:58:24 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8" returned: 0 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548adf9b-dd46-4fe4-b052-587ce3ab96fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a2cfef-b448-44b3-bce6-94d47bb403b8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ab9852-4286-4cec-9c05-0aefb408568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:24 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Volume volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 (09a2cfef-b448-44b3-bce6-94d47bb403b8): created successfully Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ab9852-4286-4cec-9c05-0aefb408568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Flow 'volume_create_manager' (2af82a7c-0f7b-4beb-b6ca-9a1af202d9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f2e7433f-49b2-464b-9af5-59d67eae6304 tempest-VolumesListTestJSON-342608604 None] Created volume successfully. Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Acquiring lock "cinder-8f3a523d-7a7d-4927-8cee-07828767484a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Lock "cinder-8f3a523d-7a7d-4927-8cee-07828767484a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Acquiring lock "cinder-quobyte-8f3a523d-7a7d-4927-8cee-07828767484a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Lock "cinder-quobyte-8f3a523d-7a7d-4927-8cee-07828767484a" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[19572e15-2dfb-40c9-83e9-7393ce69d170]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:24 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a Sep 05 20:58:24 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:25 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a" returned: 0 in 0.451s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:25 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a Sep 05 20:58:25 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:25 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8f3a523d-7a7d-4927-8cee-07828767484a" returned: 0 in 0.357s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Lock "cinder-quobyte-8f3a523d-7a7d-4927-8cee-07828767484a" released by "delete_volume" :: held 0.862s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Created reservations ['960d5f44-584a-4146-b797-bad4d6f32e27', '76a86d7e-43e3-434c-9494-48470a51a221', 'f16065c5-b679-4d06-8c95-1fa3d4d7be99', '3628e32b-a843-4b0b-bc87-dc874f5477e9'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:25 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:25 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:25 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.370s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:25 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Deleted volume successfully. Sep 05 20:58:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-62a2a28f-bcda-426d-8a73-61ee5dffc3c8 tempest-VolumeQuotasAdminTestJSON-2038478402 None] Lock "cinder-8f3a523d-7a7d-4927-8cee-07828767484a-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Acquiring lock "cinder-09a2cfef-b448-44b3-bce6-94d47bb403b8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Lock "cinder-09a2cfef-b448-44b3-bce6-94d47bb403b8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Acquiring lock "cinder-quobyte-09a2cfef-b448-44b3-bce6-94d47bb403b8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Lock "cinder-quobyte-09a2cfef-b448-44b3-bce6-94d47bb403b8" acquired by "delete_volume" :: waited 0.036s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9832fb4-558e-49b1-b609-36d7ec9ff7b7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:28 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 Sep 05 20:58:28 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:28 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8" returned: 0 in 0.542s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:28 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8 Sep 05 20:58:28 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:29 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-09a2cfef-b448-44b3-bce6-94d47bb403b8" returned: 0 in 0.377s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Lock "cinder-quobyte-09a2cfef-b448-44b3-bce6-94d47bb403b8" released by "delete_volume" :: held 0.979s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Created reservations ['6222f504-1757-4c69-b6a6-b8756b7e8890', '28470080-787d-4fd0-8538-3ea585e317ce', '52c75d3b-02b6-4a59-a315-08d6998b62c6', '5cbd42e8-dd93-4977-87db-1afff1b0a3ce'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:29 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:29 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:29 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.349s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Deleted volume successfully. Sep 05 20:58:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0fe91822-7a41-40e6-8523-33d78b7eb9fd tempest-VolumesListTestJSON-342608604 None] Lock "cinder-09a2cfef-b448-44b3-bce6-94d47bb403b8-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "cinder-23fdaf30-5814-4e58-922b-d4b37c3b0398-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-23fdaf30-5814-4e58-922b-d4b37c3b0398-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "cinder-quobyte-23fdaf30-5814-4e58-922b-d4b37c3b0398" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-quobyte-23fdaf30-5814-4e58-922b-d4b37c3b0398" acquired by "delete_volume" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:30 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[519596f1-ffdb-4f07-a442-d6a1b734c07f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:30 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 Sep 05 20:58:30 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:31 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398" returned: 0 in 0.528s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:31 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398 Sep 05 20:58:31 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:31 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fdaf30-5814-4e58-922b-d4b37c3b0398" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-quobyte-23fdaf30-5814-4e58-922b-d4b37c3b0398" released by "delete_volume" :: held 0.914s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Created reservations ['1967d62b-7850-48b1-875a-ad2ed3979461', '59187abd-c4e2-4459-bb67-5f26173ab5f0', '41c398bd-145b-44bd-8322-6292b2ff5dd0', 'c6b52eec-300f-4db2-a3ca-89df25981d5e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:31 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:31 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:32 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:32 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Deleted volume successfully. Sep 05 20:58:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f6cfa4d2-9de8-4601-899c-e39e89385309 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-23fdaf30-5814-4e58-922b-d4b37c3b0398-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "cinder-967f14d4-17e2-4127-af41-d9613d4512c9-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-967f14d4-17e2-4127-af41-d9613d4512c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "cinder-quobyte-967f14d4-17e2-4127-af41-d9613d4512c9" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-quobyte-967f14d4-17e2-4127-af41-d9613d4512c9" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[851c8a8c-dc4a-49c4-9fb2-c39c0ba166e8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:33 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 Sep 05 20:58:33 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:33 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9" returned: 0 in 0.499s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:33 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9 Sep 05 20:58:33 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:33 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-967f14d4-17e2-4127-af41-d9613d4512c9" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-quobyte-967f14d4-17e2-4127-af41-d9613d4512c9" released by "delete_volume" :: held 0.876s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Created reservations ['8b2f15ce-7896-42d8-9ab8-45d51d72d74a', '320c4930-b5d6-41ea-ac6d-c34b189488dd', '8a7cb416-2b00-4d83-9078-025d495d4aaf', 'b351ac2e-ca21-45ba-b21b-8414e138d4e7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:34 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:34 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:34 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.447s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Deleted volume successfully. Sep 05 20:58:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e1021b35-ebf3-4446-b78f-4da23369e576 tempest-VolumesListTestJSON-342608604 None] Lock "cinder-967f14d4-17e2-4127-af41-d9613d4512c9-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=111,cinder:SELECT=69,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=80,cinder:UPDATE=101,cinder:DELETE=9,cinder:INSERT=25 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Flow 'volume_create_manager' (abafa388-762e-4f23-8495-30b63b980494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66a2251-53c0-4e66-8474-151279e1216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a66a2251-53c0-4e66-8474-151279e1216f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1906017732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e17673-3634-4811-8220-e501b262707c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5503cbadb05f4869b4f61b752418366c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:40Z,use_quota=True,user_id='a854ec7e149b49e4b340523ca1d9fbc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd98f26-55fe-4e6a-aa32-e7a99dd8420f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd98f26-55fe-4e6a-aa32-e7a99dd8420f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647f403-308f-497b-bb35-2258e9192edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d647f403-308f-497b-bb35-2258e9192edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e17673-3634-4811-8220-e501b262707c', 'volume_name': 'volume-47e17673-3634-4811-8220-e501b262707c', 'volume_size': 2}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f38ab2-1457-44a5-8b4b-9c37e73d906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f38ab2-1457-44a5-8b4b-9c37e73d906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb532576-b06a-46c3-8205-def38395ef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:39 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Volume 47e17673-3634-4811-8220-e501b262707c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e17673-3634-4811-8220-e501b262707c', 'volume_size': 2} Sep 05 20:58:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1906017732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e17673-3634-4811-8220-e501b262707c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5503cbadb05f4869b4f61b752418366c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:40Z,use_quota=True,user_id='a854ec7e149b49e4b340523ca1d9fbc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Creating volume 47e17673-3634-4811-8220-e501b262707c {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:40 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c 2147483648 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:40 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c 2147483648 Sep 05 20:58:40 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:40 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c 2147483648" returned: 0 in 0.778s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:40 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c Sep 05 20:58:40 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:41 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c" returned: 0 in 0.321s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb532576-b06a-46c3-8205-def38395ef83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e17673-3634-4811-8220-e501b262707c', 'volume_size': 2}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a28566-691d-499c-8914-2c7fe3f9913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Volume volume-47e17673-3634-4811-8220-e501b262707c (47e17673-3634-4811-8220-e501b262707c): created successfully Sep 05 20:58:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a28566-691d-499c-8914-2c7fe3f9913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Flow 'volume_create_manager' (abafa388-762e-4f23-8495-30b63b980494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:41 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8c4c8010-7135-40c1-82a9-7ea30e59cba5 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Created volume successfully. Sep 05 20:58:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Creating offline snapshot 090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 of volume 47e17673-3634-4811-8220-e501b262707c {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 20:58:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb5bea-5033-4df0-bf74-e3980ecae471]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:42 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c Sep 05 20:58:42 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:42 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c" returned: 0 in 0.454s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 2G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:42 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 2G Sep 05 20:58:42 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:43 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 2G" returned: 0 in 0.767s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e17673-3634-4811-8220-e501b262707c -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:43 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e17673-3634-4811-8220-e501b262707c -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 Sep 05 20:58:43 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:43 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47e17673-3634-4811-8220-e501b262707c -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" returned: 0 in 0.503s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:43 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 is being set with open permissions: ugo+rw Sep 05 20:58:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:44 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 Sep 05 20:58:44 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:44 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" returned: 0 in 0.386s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:44 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.info Sep 05 20:58:44 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:44 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.info" returned: 0 in 0.452s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:44 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.info is being set with open permissions: ugo+rw Sep 05 20:58:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:44 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.info Sep 05 20:58:44 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:45 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.info" returned: 0 in 0.317s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bd1a2cf1-ff41-43ff-8304-0a2acdad4c16 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Create snapshot completed successfully Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "cinder-090f6c83-5c7b-4d8d-94ab-4c76c2c50e10-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-090f6c83-5c7b-4d8d-94ab-4c76c2c50e10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "cinder-quobyte-47e17673-3634-4811-8220-e501b262707c" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-quobyte-47e17673-3634-4811-8220-e501b262707c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "cinder-quobyte-090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-quobyte-090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Deleting offline snapshot 090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 of volume 47e17673-3634-4811-8220-e501b262707c {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] snapshot_file for this snap is: volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca11af48-4a0e-4496-b49a-b193bef3af7b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:45 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 Sep 05 20:58:45 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:46 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" returned: 0 in 0.501s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47e17673-3634-4811-8220-e501b262707c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 20:58:46 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80339a6-9388-4862-ac20-07a751c49a68]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:46 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c Sep 05 20:58:46 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:46 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c" returned: 0 in 0.550s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:46 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 Sep 05 20:58:46 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:47 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" returned: 0 in 0.687s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:47 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10 Sep 05 20:58:47 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Flow 'volume_create_manager' (8404c346-831c-4ea8-ad49-50b94c65ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42f6bba-47d3-4307-8788-92ba50904b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42f6bba-47d3-4307-8788-92ba50904b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1159786454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2642cd9-9a50-45ac-a7c0-359dc9817789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7422149035ee4d38a11b41f295ec88f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:47Z,use_quota=True,user_id='1580b9d5f93446a4aadc3a787ea0f3c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bc0a70-460a-4af0-8204-a4633deac8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bc0a70-460a-4af0-8204-a4633deac8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde9478e-cf4e-4d89-baac-391bbec69d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde9478e-cf4e-4d89-baac-391bbec69d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2642cd9-9a50-45ac-a7c0-359dc9817789', 'volume_name': 'volume-d2642cd9-9a50-45ac-a7c0-359dc9817789', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215fdf65-5990-4af3-a087-85d87451b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215fdf65-5990-4af3-a087-85d87451b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8fb939-8bca-49b4-b163-737abf1cb503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Volume d2642cd9-9a50-45ac-a7c0-359dc9817789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2642cd9-9a50-45ac-a7c0-359dc9817789', 'volume_size': 1} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1159786454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2642cd9-9a50-45ac-a7c0-359dc9817789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7422149035ee4d38a11b41f295ec88f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:47Z,use_quota=True,user_id='1580b9d5f93446a4aadc3a787ea0f3c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Creating volume d2642cd9-9a50-45ac-a7c0-359dc9817789 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:47 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:47 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 1073741824 Sep 05 20:58:47 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:47 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c.090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" returned: 0 in 0.354s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-quobyte-090f6c83-5c7b-4d8d-94ab-4c76c2c50e10" released by "_delete_snapshot" :: held 2.275s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-quobyte-47e17673-3634-4811-8220-e501b262707c" released by "delete_snapshot" :: held 2.313s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:47 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Created reservations ['23eb3f18-adf3-4aa7-a7a8-dcd68670f27f', '7be92065-2605-4e28-bafa-21e55830c234', 'ec4b61b3-12a7-42a0-9117-4e026440f6b7', '603c8e7e-0cde-4e79-9ec5-ecb6bf6895bb'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Delete snapshot completed successfully. Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-883c5b34-b623-4d38-a109-c818c15638e1 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-090f6c83-5c7b-4d8d-94ab-4c76c2c50e10-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:48 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 1073741824" returned: 0 in 0.585s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:48 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 Sep 05 20:58:48 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:48 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789" returned: 0 in 0.296s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8fb939-8bca-49b4-b163-737abf1cb503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2642cd9-9a50-45ac-a7c0-359dc9817789', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dad10a1-afe2-4938-bd47-f985d70bb86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:48 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Volume volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 (d2642cd9-9a50-45ac-a7c0-359dc9817789): created successfully Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dad10a1-afe2-4938-bd47-f985d70bb86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Flow 'volume_create_manager' (8404c346-831c-4ea8-ad49-50b94c65ea60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f03ddecc-0432-4222-8a39-76cde361e6ad tempest-VolumesMetadataTest-395298867 None] Created volume successfully. Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "cinder-47e17673-3634-4811-8220-e501b262707c-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-47e17673-3634-4811-8220-e501b262707c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "cinder-quobyte-47e17673-3634-4811-8220-e501b262707c" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-quobyte-47e17673-3634-4811-8220-e501b262707c" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b32c96-b3dd-45f2-9337-5e3bea8b0f9d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:49 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c Sep 05 20:58:49 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:49 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:49 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c Sep 05 20:58:49 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:49 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-47e17673-3634-4811-8220-e501b262707c" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-quobyte-47e17673-3634-4811-8220-e501b262707c" released by "delete_volume" :: held 0.760s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Created reservations ['5c70edd4-877c-4b45-9dd8-4394077a50f3', '5620679a-d292-4daa-ae0e-9a00dc0431c2', '57337fc0-677a-4306-9f9c-4c1abd0220c0', 'cd2ee4ce-7bd9-401e-acf5-4529867a8327'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:49 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:49 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:50 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.290s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Deleted volume successfully. Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d0eea5bc-d382-4285-b0f0-f434c53d86f7 tempest-VolumesSnapshotNegativeTestJSON-661178257 None] Lock "cinder-47e17673-3634-4811-8220-e501b262707c-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Acquiring lock "cinder-d2642cd9-9a50-45ac-a7c0-359dc9817789-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Lock "cinder-d2642cd9-9a50-45ac-a7c0-359dc9817789-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Acquiring lock "cinder-quobyte-d2642cd9-9a50-45ac-a7c0-359dc9817789" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Lock "cinder-quobyte-d2642cd9-9a50-45ac-a7c0-359dc9817789" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c51dd0-83ca-4ef5-a322-8ca3f4a7280d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:50 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 Sep 05 20:58:50 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:50 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789" returned: 0 in 0.416s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:51 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789 Sep 05 20:58:51 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:51 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d2642cd9-9a50-45ac-a7c0-359dc9817789" returned: 0 in 0.339s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Lock "cinder-quobyte-d2642cd9-9a50-45ac-a7c0-359dc9817789" released by "delete_volume" :: held 0.807s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Created reservations ['c9c93856-27c9-4e6c-a48b-6fb26609f578', '3a51e1bf-6d5a-4768-865e-f61bafd9efd5', 'c6b7c71d-072a-465d-87e9-b61b276efeb1', '090c4c5f-517e-48e5-84d1-ef920f20fd16'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:51 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:51 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:51 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.344s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Deleted volume successfully. Sep 05 20:58:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6796025e-235b-44fe-bdb5-791d3286fc3d tempest-VolumesMetadataTest-395298867 None] Lock "cinder-d2642cd9-9a50-45ac-a7c0-359dc9817789-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Flow 'volume_create_manager' (33e3ade4-4b7f-45b5-b4d9-74babe59a5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2945d71-8215-43e8-ab39-b134784c1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2945d71-8215-43e8-ab39-b134784c1b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1908879951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d02fbf-da74-4d0d-a721-3410f135b3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0767a54e027a468f9e620072e6c819f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:56Z,use_quota=True,user_id='2bc2c6886fcc42d9a0286bf6f371401b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e5fd26-4706-4ee9-8be6-c4bccd493388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e5fd26-4706-4ee9-8be6-c4bccd493388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e12926f-6dd5-41e2-88ec-fdf15f89ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e12926f-6dd5-41e2-88ec-fdf15f89ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d02fbf-da74-4d0d-a721-3410f135b3b3', 'volume_name': 'volume-05d02fbf-da74-4d0d-a721-3410f135b3b3', 'volume_size': 2}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeafa23-87a9-4b85-a6a9-76b104050cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aeafa23-87a9-4b85-a6a9-76b104050cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff21822d-6c8f-47bb-bec4-e40f61919838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:56 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Volume 05d02fbf-da74-4d0d-a721-3410f135b3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d02fbf-da74-4d0d-a721-3410f135b3b3', 'volume_size': 2} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1908879951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d02fbf-da74-4d0d-a721-3410f135b3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0767a54e027a468f9e620072e6c819f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:58:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:58:56Z,use_quota=True,user_id='2bc2c6886fcc42d9a0286bf6f371401b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Creating volume 05d02fbf-da74-4d0d-a721-3410f135b3b3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:58:56 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:58:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 2147483648 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:56 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 2147483648 Sep 05 20:58:56 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:57 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 2147483648" returned: 0 in 0.566s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:57 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 Sep 05 20:58:57 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:57 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3" returned: 0 in 0.360s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff21822d-6c8f-47bb-bec4-e40f61919838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d02fbf-da74-4d0d-a721-3410f135b3b3', 'volume_size': 2}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ee925b-f3c5-4377-9d7c-0788c6394789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:58:57 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Volume volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 (05d02fbf-da74-4d0d-a721-3410f135b3b3): created successfully Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ee925b-f3c5-4377-9d7c-0788c6394789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:58:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Flow 'volume_create_manager' (33e3ade4-4b7f-45b5-b4d9-74babe59a5fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:58:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-15d0d03a-b172-4e3a-93e7-23c817cc370c tempest-VolumesCloneNegativeTest-84907096 None] Created volume successfully. Sep 05 20:58:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Acquiring lock "cinder-05d02fbf-da74-4d0d-a721-3410f135b3b3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Lock "cinder-05d02fbf-da74-4d0d-a721-3410f135b3b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Acquiring lock "cinder-quobyte-05d02fbf-da74-4d0d-a721-3410f135b3b3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 20:58:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Lock "cinder-quobyte-05d02fbf-da74-4d0d-a721-3410f135b3b3" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 20:58:58 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[90daed0a-49a3-482d-8cb3-1278d66f3c30]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:58:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:58 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 Sep 05 20:58:58 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:59 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3" returned: 0 in 0.498s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:59 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3 Sep 05 20:58:59 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:59 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-05d02fbf-da74-4d0d-a721-3410f135b3b3" returned: 0 in 0.279s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Lock "cinder-quobyte-05d02fbf-da74-4d0d-a721-3410f135b3b3" released by "delete_volume" :: held 0.823s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Created reservations ['2b4ae4be-344e-4acf-841c-bcd958f8e610', '13da50a5-2e35-48ef-8ad8-ef291aa916ed', '0ae76601-8051-44d3-ae87-04638a685eb7', '6f23ae65-9827-46ca-8e67-12f84774feb1'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:58:59 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:58:59 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:58:59 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:58:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Deleted volume successfully. Sep 05 20:58:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f866b50a-8a67-430e-a85b-6c15c36c413d tempest-VolumesCloneNegativeTest-84907096 None] Lock "cinder-05d02fbf-da74-4d0d-a721-3410f135b3b3-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 20:59:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:59:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:59:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:59:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:04 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 20:59:04 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:05 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.358s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 20:59:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 20:59:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 20:59:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 20:59:09 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=30,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:59:09 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=29,cinder:UPDATE=40,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Flow 'volume_create_manager' (259d733e-fbdd-4dcc-b0f8-603ce7488289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bc5088-269a-444b-9134-738ec77de8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bc5088-269a-444b-9134-738ec77de8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1971717225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4561905f-632b-4dc3-aa74-06e371da45c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b0f37f62734037b7f8a58eddf1b8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:11Z,use_quota=True,user_id='584fc18d342746cda7d2530167e9c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343d8ec2-00c6-449f-b4cc-545af5e4133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343d8ec2-00c6-449f-b4cc-545af5e4133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a195e463-3376-475a-9690-7355d4c178b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a195e463-3376-475a-9690-7355d4c178b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4561905f-632b-4dc3-aa74-06e371da45c8', 'volume_name': 'volume-4561905f-632b-4dc3-aa74-06e371da45c8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de023094-3f10-4300-a73e-6999ab657e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de023094-3f10-4300-a73e-6999ab657e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f254ff-3b47-4fd4-8078-3faced9bc987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Volume 4561905f-632b-4dc3-aa74-06e371da45c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4561905f-632b-4dc3-aa74-06e371da45c8', 'volume_size': 1} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1971717225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4561905f-632b-4dc3-aa74-06e371da45c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b0f37f62734037b7f8a58eddf1b8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:11Z,use_quota=True,user_id='584fc18d342746cda7d2530167e9c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Creating volume 4561905f-632b-4dc3-aa74-06e371da45c8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:59:11 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:11 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 1073741824 Sep 05 20:59:11 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:11 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 1073741824" returned: 0 in 0.539s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:11 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 Sep 05 20:59:11 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:12 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8" returned: 0 in 0.298s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f254ff-3b47-4fd4-8078-3faced9bc987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4561905f-632b-4dc3-aa74-06e371da45c8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba71f04e-c16e-445c-a760-2692f592f597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:12 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Volume volume-4561905f-632b-4dc3-aa74-06e371da45c8 (4561905f-632b-4dc3-aa74-06e371da45c8): created successfully Sep 05 20:59:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba71f04e-c16e-445c-a760-2692f592f597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Flow 'volume_create_manager' (259d733e-fbdd-4dcc-b0f8-603ce7488289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:12 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3edc3d2b-ba27-4b87-9ddc-5989e07f0e90 tempest-AttachVolumeTestJSON-461879325 None] Created volume successfully. Sep 05 20:59:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-2f9f274a-a633-49cc-8196-ca86098e3922 req-8b005234-75b3-465a-a6ea-a317971d4c57 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-2f9f274a-a633-49cc-8196-ca86098e3922 req-8b005234-75b3-465a-a6ea-a317971d4c57 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-2f9f274a-a633-49cc-8196-ca86098e3922 req-8b005234-75b3-465a-a6ea-a317971d4c57 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-2f9f274a-a633-49cc-8196-ca86098e3922 req-8b005234-75b3-465a-a6ea-a317971d4c57 tempest-AttachVolumeTestJSON-461879325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-4561905f-632b-4dc3-aa74-06e371da45c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad0cdf9e-3a8b-4082-abf0-b3dade959bdd', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:59:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-2f9f274a-a633-49cc-8196-ca86098e3922 req-8b005234-75b3-465a-a6ea-a317971d4c57 tempest-AttachVolumeTestJSON-461879325 None] attachment_update completed successfully. Sep 05 20:59:24 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:59:24 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Flow 'volume_create_manager' (43819ec9-e3e4-4012-bba1-fc0dee249987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cc3beb-8661-4660-8b86-0189ee3f6dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cc3beb-8661-4660-8b86-0189ee3f6dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1978547031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6114f6b1-01c4-4b1f-a995-35fbe1c0285e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04521e6a59034500b01030ed8beeec1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:32Z,use_quota=True,user_id='14d5f012ab5340239932c406a828683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac8788f-2e77-42ac-96a4-3caeb63ed27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ac8788f-2e77-42ac-96a4-3caeb63ed27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bc48cd-0648-4f73-b488-8fd3b1733b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bc48cd-0648-4f73-b488-8fd3b1733b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6114f6b1-01c4-4b1f-a995-35fbe1c0285e', 'volume_name': 'volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c156e977-6fd6-424c-b3ab-5ce483206603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c156e977-6fd6-424c-b3ab-5ce483206603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29334fc4-70c0-4879-8d4c-35a9e70b88c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Volume 6114f6b1-01c4-4b1f-a995-35fbe1c0285e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e', 'volume_size': 1} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1978547031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6114f6b1-01c4-4b1f-a995-35fbe1c0285e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04521e6a59034500b01030ed8beeec1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:32Z,use_quota=True,user_id='14d5f012ab5340239932c406a828683e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Creating volume 6114f6b1-01c4-4b1f-a995-35fbe1c0285e {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:59:32 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:32 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e 1073741824 Sep 05 20:59:32 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:32 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e 1073741824" returned: 0 in 0.593s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:32 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e Sep 05 20:59:32 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:33 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e" returned: 0 in 0.624s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29334fc4-70c0-4879-8d4c-35a9e70b88c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb3ac53-f793-46ea-8e92-f4f4f1da007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Volume volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e (6114f6b1-01c4-4b1f-a995-35fbe1c0285e): created successfully Sep 05 20:59:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb3ac53-f793-46ea-8e92-f4f4f1da007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Flow 'volume_create_manager' (43819ec9-e3e4-4012-bba1-fc0dee249987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:33 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e63f7fcd-47f1-4c39-93b0-5c52f0bf2011 tempest-TestMinimumBasicScenario-1319795738 None] Created volume successfully. Sep 05 20:59:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-9c7117cf-8b06-4445-ba51-e0f78edc436d req-32f6ba0b-3702-4560-a497-fd35114b5aa5 tempest-TestMinimumBasicScenario-1319795738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-9c7117cf-8b06-4445-ba51-e0f78edc436d req-32f6ba0b-3702-4560-a497-fd35114b5aa5 tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-9c7117cf-8b06-4445-ba51-e0f78edc436d req-32f6ba0b-3702-4560-a497-fd35114b5aa5 tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-9c7117cf-8b06-4445-ba51-e0f78edc436d req-32f6ba0b-3702-4560-a497-fd35114b5aa5 tempest-TestMinimumBasicScenario-1319795738 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cffbadcd-50c4-4f41-950d-6733ce4019f1', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 20:59:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-9c7117cf-8b06-4445-ba51-e0f78edc436d req-32f6ba0b-3702-4560-a497-fd35114b5aa5 tempest-TestMinimumBasicScenario-1319795738 None] attachment_update completed successfully. Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Flow 'volume_create_manager' (30a35c60-2286-411c-abb3-cef4fdbe7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7175a9-8be4-4723-9998-9fe7d3b3102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a7175a9-8be4-4723-9998-9fe7d3b3102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1164235652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49396454-f8d2-4123-8c78-0cb585eccafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f3ddcd40e43baaa3df065db7b9290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:46Z,use_quota=True,user_id='1c80e990d2e845c3b2ebfd9824d0220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2dad72-7b91-4a3a-a20d-15caba837dcc),volume_type_id=6f2dad72-7b91-4a3a-a20d-15caba837dcc)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040cf2b5-522b-424d-9dd6-96f87c7640a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040cf2b5-522b-424d-9dd6-96f87c7640a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a52d7f-0ac9-4b88-b0ea-e316e7fca058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a52d7f-0ac9-4b88-b0ea-e316e7fca058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49396454-f8d2-4123-8c78-0cb585eccafe', 'volume_name': 'volume-49396454-f8d2-4123-8c78-0cb585eccafe', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba001b-78c2-4396-b510-5a6449a44368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ba001b-78c2-4396-b510-5a6449a44368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9680b734-e661-4fff-b475-699aeaceb187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume 49396454-f8d2-4123-8c78-0cb585eccafe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49396454-f8d2-4123-8c78-0cb585eccafe', 'volume_size': 1} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1164235652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49396454-f8d2-4123-8c78-0cb585eccafe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f3ddcd40e43baaa3df065db7b9290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:46Z,use_quota=True,user_id='1c80e990d2e845c3b2ebfd9824d0220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f2dad72-7b91-4a3a-a20d-15caba837dcc),volume_type_id=6f2dad72-7b91-4a3a-a20d-15caba837dcc)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Creating volume 49396454-f8d2-4123-8c78-0cb585eccafe {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:59:46 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:46 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe 1073741824 Sep 05 20:59:46 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Flow 'volume_create_manager' (1b8c1326-9172-415c-819a-c65cd99fbfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542df6d8-76d6-46a0-8fc0-01b7281c2e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542df6d8-76d6-46a0-8fc0-01b7281c2e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-442374563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f3ddcd40e43baaa3df065db7b9290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:47Z,use_quota=True,user_id='1c80e990d2e845c3b2ebfd9824d0220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3626b59f-b59e-45e4-98db-90319a374fb1),volume_type_id=3626b59f-b59e-45e4-98db-90319a374fb1)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fbf6c4-9552-42e9-9a66-c9eb057e986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fbf6c4-9552-42e9-9a66-c9eb057e986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb199a-96f3-4d97-91e7-49487fecfeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eb199a-96f3-4d97-91e7-49487fecfeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b', 'volume_name': 'volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787edeba-a39b-48dc-8768-f863e90eec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787edeba-a39b-48dc-8768-f863e90eec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1518d7-3970-4f74-9644-51e09fc5c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume 7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b', 'volume_size': 1} Sep 05 20:59:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:47 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe 1073741824" returned: 0 in 0.584s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:47 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe Sep 05 20:59:47 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:47 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-442374563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f3ddcd40e43baaa3df065db7b9290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:47Z,use_quota=True,user_id='1c80e990d2e845c3b2ebfd9824d0220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3626b59f-b59e-45e4-98db-90319a374fb1),volume_type_id=3626b59f-b59e-45e4-98db-90319a374fb1)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Creating volume 7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:59:47 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9680b734-e661-4fff-b475-699aeaceb187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49396454-f8d2-4123-8c78-0cb585eccafe', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd8807d-29cc-4e55-b36e-c2a108bb79f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:47 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b 1073741824 Sep 05 20:59:47 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume volume-49396454-f8d2-4123-8c78-0cb585eccafe (49396454-f8d2-4123-8c78-0cb585eccafe): created successfully Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd8807d-29cc-4e55-b36e-c2a108bb79f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Flow 'volume_create_manager' (30a35c60-2286-411c-abb3-cef4fdbe7595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a8cfdbaf-e1fe-4d8f-8ccc-47ecff808a70 tempest-TestInstancesWithCinderVolumes-1431833702 None] Created volume successfully. Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Flow 'volume_create_manager' (d2852bbd-1bcf-4da0-a239-7982793f2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19f4801-9efb-401b-b66d-ad972605d697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19f4801-9efb-401b-b66d-ad972605d697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2048360437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9ad43a-7e34-4409-8f78-b363f8422064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f3ddcd40e43baaa3df065db7b9290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:48Z,use_quota=True,user_id='1c80e990d2e845c3b2ebfd9824d0220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e48868a-125c-453d-99da-44cc0a6bf007),volume_type_id=9e48868a-125c-453d-99da-44cc0a6bf007)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb83e80c-c3e3-4af1-952a-5240595537ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb83e80c-c3e3-4af1-952a-5240595537ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a473cc2a-fd4c-4632-80c8-0a76a579616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:47 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 20:59:48 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b 1073741824" returned: 0 in 0.726s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:48 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b Sep 05 20:59:48 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a473cc2a-fd4c-4632-80c8-0a76a579616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa9ad43a-7e34-4409-8f78-b363f8422064', 'volume_name': 'volume-fa9ad43a-7e34-4409-8f78-b363f8422064', 'volume_size': 1, 'image_id': '6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--824654008', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '450f3ddcd40e43baaa3df065db7b9290', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'created_at': datetime.datetime(2026, 9, 5, 18, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 59, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5/file', 'properties': {}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2c942e-2dde-4cdf-9b90-7a809b8aac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c2c942e-2dde-4cdf-9b90-7a809b8aac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8d5759-c9a9-46d7-969a-0a59b6bd2658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:48 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume fa9ad43a-7e34-4409-8f78-b363f8422064: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa9ad43a-7e34-4409-8f78-b363f8422064', 'volume_size': 1, 'image_id': '6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--824654008', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '450f3ddcd40e43baaa3df065db7b9290', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'created_at': datetime.datetime(2026, 9, 5, 18, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 59, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5/file', 'properties': {}}, 'image_service': } Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Trying to clone fa9ad43a-7e34-4409-8f78-b363f8422064 from image 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 20:59:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-d58ce005-45ed-405b-8947-94ff7ec67141 req-7092c9e5-f7fb-4446-bf52-d2a99838600a tempest-AttachVolumeTestJSON-461879325 None] Terminate volume connection completed successfully. Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-d58ce005-45ed-405b-8947-94ff7ec67141 req-7092c9e5-f7fb-4446-bf52-d2a99838600a tempest-AttachVolumeTestJSON-461879325 None] Deleting attachment ad0cdf9e-3a8b-4082-abf0-b3dade959bdd. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 20:59:48 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b" returned: 0 in 0.427s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1518d7-3970-4f74-9644-51e09fc5c50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57af4694-86e8-4c00-a771-8bc1db8f9b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:48 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b (7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b): created successfully Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57af4694-86e8-4c00-a771-8bc1db8f9b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Flow 'volume_create_manager' (1b8c1326-9172-415c-819a-c65cd99fbfdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e0766e98-9110-4ac7-a863-6ea6a75a476b tempest-TestInstancesWithCinderVolumes-1431833702 None] Created volume successfully. Sep 05 20:59:52 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD, size 20.69 MB, duration 4.51 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 20:59:52 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Image download 20.69 MB at 4.58 MB/s Sep 05 20:59:52 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a02c2bd-a97f-40e7-81f2-9b507c3e51db]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:53 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD Sep 05 20:59:53 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:53 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:53 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Temporary image 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 is fetched for user 1c80e990d2e845c3b2ebfd9824d0220c. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 20:59:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f9d995-b9a7-4187-ad83-dad3245d1b0a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:53 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD Sep 05 20:59:53 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:54 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD" returned: 0 in 0.660s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2048360437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9ad43a-7e34-4409-8f78-b363f8422064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f3ddcd40e43baaa3df065db7b9290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T18:59:48Z,use_quota=True,user_id='1c80e990d2e845c3b2ebfd9824d0220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e48868a-125c-453d-99da-44cc0a6bf007),volume_type_id=9e48868a-125c-453d-99da-44cc0a6bf007)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Creating volume fa9ad43a-7e34-4409-8f78-b363f8422064 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 20:59:54 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:54 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 1073741824 Sep 05 20:59:54 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:54 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 1073741824" returned: 0 in 0.711s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:55 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 Sep 05 20:59:55 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:55 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064" returned: 0 in 0.334s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Attempting download of 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'metadata': {}}])) to volume fa9ad43a-7e34-4409-8f78-b363f8422064. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[391215b6-0cef-4a1f-9220-f6602dbee160]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_y2hgb5eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:55 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_y2hgb5eb Sep 05 20:59:55 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:55 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_y2hgb5eb" returned: 0 in 0.431s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_y2hgb5eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:56 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_y2hgb5eb Sep 05 20:59:56 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:56 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_y2hgb5eb" returned: 1 in 0.464s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_y2hgb5eb' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 20:59:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7878725-9d0a-4fa2-846a-b120478eb008]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 20:59:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:56 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD Sep 05 20:59:56 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:56 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:56 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 was qcow2, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 20:59:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:56 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 Sep 05 20:59:56 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:59 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064" returned: 0 in 2.286s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5_at2eunq2devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 20:59:59 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Converted 112.00 MB image at 48.94 MB/s Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 20:59:59 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 1G Sep 05 20:59:59 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 20:59:59 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 1G" returned: 0 in 0.385s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Downloaded image 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'metadata': {}}])) to volume fa9ad43a-7e34-4409-8f78-b363f8422064 successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Temporary image 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 for user 1c80e990d2e845c3b2ebfd9824d0220c is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Marking volume fa9ad43a-7e34-4409-8f78-b363f8422064 as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Copying metadata from image 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 to fa9ad43a-7e34-4409-8f78-b363f8422064. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Creating volume glance metadata for volume fa9ad43a-7e34-4409-8f78-b363f8422064 backed by image 6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5 with: {'image_id': '6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'image_name': 'tempest-scenario-img--824654008', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8d5759-c9a9-46d7-969a-0a59b6bd2658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9ad43a-7e34-4409-8f78-b363f8422064', 'volume_size': 1, 'image_id': '6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--824654008', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '450f3ddcd40e43baaa3df065db7b9290', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5', 'created_at': datetime.datetime(2026, 9, 5, 18, 59, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 59, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6419a9a0-4ecc-4a9e-bf8e-c2a5a7ed42e5/file', 'properties': {}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c542b934-b9a6-490c-9764-03413b7b50c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 20:59:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Volume volume-fa9ad43a-7e34-4409-8f78-b363f8422064 (fa9ad43a-7e34-4409-8f78-b363f8422064): created successfully Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c542b934-b9a6-490c-9764-03413b7b50c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 20:59:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Flow 'volume_create_manager' (d2852bbd-1bcf-4da0-a239-7982793f2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 20:59:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-239e3935-88dc-4b29-ba6c-e32937ef4136 tempest-TestInstancesWithCinderVolumes-1431833702 None] Created volume successfully. Sep 05 21:00:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4df58664-9b9d-448b-920c-7ddb367cf781 req-aadd7c9b-1e9c-4f50-82c5-a9de3f45c17b tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4df58664-9b9d-448b-920c-7ddb367cf781 req-aadd7c9b-1e9c-4f50-82c5-a9de3f45c17b tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4df58664-9b9d-448b-920c-7ddb367cf781 req-aadd7c9b-1e9c-4f50-82c5-a9de3f45c17b tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-4df58664-9b9d-448b-920c-7ddb367cf781 req-aadd7c9b-1e9c-4f50-82c5-a9de3f45c17b tempest-TestInstancesWithCinderVolumes-1431833702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-fa9ad43a-7e34-4409-8f78-b363f8422064', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4852a11c-785b-43a1-a641-b9ba19a9eff3', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:00:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-4df58664-9b9d-448b-920c-7ddb367cf781 req-aadd7c9b-1e9c-4f50-82c5-a9de3f45c17b tempest-TestInstancesWithCinderVolumes-1431833702 None] attachment_update completed successfully. Sep 05 21:00:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:00:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:00:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:00:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:04 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:00:04 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:05 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.707s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:00:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:00:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:00:14 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=15,cinder:DELETE=4,cinder:SELECT=28,cinder:INSERT=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:00:14 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=28,cinder:INSERT=11,cinder:UPDATE=19 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:00:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-cc8a5b88-58ee-45ea-b15d-3620162e039e req-43870937-c793-444d-90a1-01208b9d8180 tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-cc8a5b88-58ee-45ea-b15d-3620162e039e req-43870937-c793-444d-90a1-01208b9d8180 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-cc8a5b88-58ee-45ea-b15d-3620162e039e req-43870937-c793-444d-90a1-01208b9d8180 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-cc8a5b88-58ee-45ea-b15d-3620162e039e req-43870937-c793-444d-90a1-01208b9d8180 tempest-TestInstancesWithCinderVolumes-1431833702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-49396454-f8d2-4123-8c78-0cb585eccafe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51c75472-2b81-4e87-981e-9bdeb2b81a8a', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:00:39 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-cc8a5b88-58ee-45ea-b15d-3620162e039e req-43870937-c793-444d-90a1-01208b9d8180 tempest-TestInstancesWithCinderVolumes-1431833702 None] attachment_update completed successfully. Sep 05 21:00:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-7f8d5369-5016-4acc-b5bd-f6437f9318a1 req-751e086b-04d4-4084-9dbf-adab36a96fca tempest-TestMinimumBasicScenario-1319795738 None] Terminate volume connection completed successfully. Sep 05 21:00:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f8d5369-5016-4acc-b5bd-f6437f9318a1 req-751e086b-04d4-4084-9dbf-adab36a96fca tempest-TestMinimumBasicScenario-1319795738 None] Deleting attachment cffbadcd-50c4-4f41-950d-6733ce4019f1. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:00:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Acquiring lock "cinder-6114f6b1-01c4-4b1f-a995-35fbe1c0285e-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Lock "cinder-6114f6b1-01c4-4b1f-a995-35fbe1c0285e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Acquiring lock "cinder-quobyte-6114f6b1-01c4-4b1f-a995-35fbe1c0285e" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Lock "cinder-quobyte-6114f6b1-01c4-4b1f-a995-35fbe1c0285e" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:41 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49b8260-c897-4427-97b0-db35c291923b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:41 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e Sep 05 21:00:41 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:42 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e" returned: 0 in 0.543s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:42 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e Sep 05 21:00:42 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:42 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6114f6b1-01c4-4b1f-a995-35fbe1c0285e" returned: 0 in 0.437s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Lock "cinder-quobyte-6114f6b1-01c4-4b1f-a995-35fbe1c0285e" released by "delete_volume" :: held 1.059s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:42 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Created reservations ['005dffa2-0bef-4093-b74b-03db95e7c859', '66bf07a4-e01e-497c-8553-a6597b8fc59d', '7d31bc31-a736-48b7-b224-0e7e184f1dd6', '1f329d13-cc00-4dce-aa31-62a954466540'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:43 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:00:43 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:43 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Deleted volume successfully. Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-5cdaf3c9-7cde-4b92-98a7-781873a48b41 req-8bf50818-c208-4766-a558-a46022ac0e01 tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-5cdaf3c9-7cde-4b92-98a7-781873a48b41 req-8bf50818-c208-4766-a558-a46022ac0e01 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-5cdaf3c9-7cde-4b92-98a7-781873a48b41 req-8bf50818-c208-4766-a558-a46022ac0e01 tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8257456d-b03c-4733-adaa-b018248cf44c tempest-TestMinimumBasicScenario-1319795738 None] Lock "cinder-6114f6b1-01c4-4b1f-a995-35fbe1c0285e-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-5cdaf3c9-7cde-4b92-98a7-781873a48b41 req-8bf50818-c208-4766-a558-a46022ac0e01 tempest-TestInstancesWithCinderVolumes-1431833702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e0181d2-da12-4ffb-a93e-cb66feb77313', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:00:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-5cdaf3c9-7cde-4b92-98a7-781873a48b41 req-8bf50818-c208-4766-a558-a46022ac0e01 tempest-TestInstancesWithCinderVolumes-1431833702 None] attachment_update completed successfully. Sep 05 21:00:49 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-1f3bfb12-bdee-426d-a53d-d6fe1e9536a7 req-6656b866-5553-45c9-a16e-a4bf01694391 tempest-TestInstancesWithCinderVolumes-1431833702 None] Terminate volume connection completed successfully. Sep 05 21:00:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-1f3bfb12-bdee-426d-a53d-d6fe1e9536a7 req-6656b866-5553-45c9-a16e-a4bf01694391 tempest-TestInstancesWithCinderVolumes-1431833702 None] Deleting attachment 51c75472-2b81-4e87-981e-9bdeb2b81a8a. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:00:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "cinder-49396454-f8d2-4123-8c78-0cb585eccafe-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-49396454-f8d2-4123-8c78-0cb585eccafe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "cinder-quobyte-49396454-f8d2-4123-8c78-0cb585eccafe" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-quobyte-49396454-f8d2-4123-8c78-0cb585eccafe" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[38957d2d-db3c-447f-b831-cc9e196ff7aa]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:51 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe Sep 05 21:00:51 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:51 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe" returned: 0 in 0.488s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:51 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe Sep 05 21:00:51 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:51 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49396454-f8d2-4123-8c78-0cb585eccafe" returned: 0 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-quobyte-49396454-f8d2-4123-8c78-0cb585eccafe" released by "delete_volume" :: held 0.890s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:51 devstack cinder-volume[87778]: WARNING cinder.quota [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-632850429-1822700990 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-632850429-1822700990, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:00:51 devstack cinder-volume[87778]: WARNING cinder.quota [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-632850429-1822700990 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-632850429-1822700990, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Created reservations ['d1ef0128-207f-484a-a04e-40537631bceb', 'ac2b1860-7cfe-4588-bfc1-e92e90937c0e', 'c32da36f-4df9-42fc-b194-b84acdc7e70b', '0ea2089f-f1e6-4303-850a-093e9f88e369'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:51 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:00:51 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:52 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:52 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Deleted volume successfully. Sep 05 21:00:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9c6c800-c6e9-4649-a257-5004aa384d7c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-49396454-f8d2-4123-8c78-0cb585eccafe-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:55 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-c4c42324-3dcb-44d0-ae51-6d8714315f63 req-75a0b686-a6dd-4633-ab45-66cf1613d333 tempest-TestInstancesWithCinderVolumes-1431833702 None] Terminate volume connection completed successfully. Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-c4c42324-3dcb-44d0-ae51-6d8714315f63 req-75a0b686-a6dd-4633-ab45-66cf1613d333 tempest-TestInstancesWithCinderVolumes-1431833702 None] Deleting attachment 1e0181d2-da12-4ffb-a93e-cb66feb77313. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Flow 'volume_create_manager' (0aa87f63-4918-4c12-b17d-42620c5db781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3423f187-3d13-49b3-b24a-9f64bddd3b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3423f187-3d13-49b3-b24a-9f64bddd3b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1019031133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1b1028-2b22-4c31-9056-8ef409e8f66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b0f37f62734037b7f8a58eddf1b8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:56Z,use_quota=True,user_id='584fc18d342746cda7d2530167e9c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a19f55-4a46-4ba0-b488-3c92976adf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a19f55-4a46-4ba0-b488-3c92976adf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06649878-49e2-4446-ab77-7de613b2078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06649878-49e2-4446-ab77-7de613b2078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1b1028-2b22-4c31-9056-8ef409e8f66f', 'volume_name': 'volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca5714d-4af5-4365-8231-e5a80a472e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca5714d-4af5-4365-8231-e5a80a472e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59259525-ce98-4319-b0f8-78400f11dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:55 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Volume 0b1b1028-2b22-4c31-9056-8ef409e8f66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f', 'volume_size': 1} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1019031133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1b1028-2b22-4c31-9056-8ef409e8f66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b0f37f62734037b7f8a58eddf1b8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:00:56Z,use_quota=True,user_id='584fc18d342746cda7d2530167e9c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Creating volume 0b1b1028-2b22-4c31-9056-8ef409e8f66f {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:00:55 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:55 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f 1073741824 Sep 05 21:00:55 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "cinder-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "cinder-quobyte-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-quobyte-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bca7bc6-71fa-4b7d-8acb-df508a1b16c2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:56 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b Sep 05 21:00:56 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:56 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f 1073741824" returned: 0 in 0.697s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:56 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f Sep 05 21:00:56 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:56 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b" returned: 0 in 0.572s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:56 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b Sep 05 21:00:56 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:56 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f" returned: 0 in 0.431s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:00:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59259525-ce98-4319-b0f8-78400f11dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3d9807-6046-447b-a050-d3eca92d170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:00:57 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Volume volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f (0b1b1028-2b22-4c31-9056-8ef409e8f66f): created successfully Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3d9807-6046-447b-a050-d3eca92d170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Flow 'volume_create_manager' (0aa87f63-4918-4c12-b17d-42620c5db781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:00:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-54f2f0a4-1015-4fb1-a36b-ff368bedb358 tempest-AttachVolumeTestJSON-461879325 None] Created volume successfully. Sep 05 21:00:57 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b" returned: 0 in 0.403s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-quobyte-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b" released by "delete_volume" :: held 1.034s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:57 devstack cinder-volume[87778]: WARNING cinder.quota [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1127732408-222551114 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1127732408-222551114, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:00:57 devstack cinder-volume[87778]: WARNING cinder.quota [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1127732408-222551114 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1127732408-222551114, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Created reservations ['9d99e308-d5d5-4c9c-a10b-74e26e9e65cf', 'fc3ddc1d-782e-44f8-8168-56a2838a3919', '1f2a22e4-6010-4502-9f34-978bfef445f6', '0bc60f0c-6e20-45d6-9288-2abd8985d3cb'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:00:57 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:00:57 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:00:57 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.369s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:00:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Deleted volume successfully. Sep 05 21:00:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-593eb3e0-fb86-43c1-b7ff-d9d9e3e5502c tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-7d395ff2-fb0b-482c-8d89-4ecd3fef3c2b-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:00:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-986f02c7-7eaa-414f-aa0c-e08b66913afb req-54af8af7-aeab-45b5-a6be-7bb51230cf24 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:00:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-986f02c7-7eaa-414f-aa0c-e08b66913afb req-54af8af7-aeab-45b5-a6be-7bb51230cf24 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:00:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-986f02c7-7eaa-414f-aa0c-e08b66913afb req-54af8af7-aeab-45b5-a6be-7bb51230cf24 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:00:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-986f02c7-7eaa-414f-aa0c-e08b66913afb req-54af8af7-aeab-45b5-a6be-7bb51230cf24 tempest-AttachVolumeTestJSON-461879325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe9cda52-05ec-4c3c-9d3f-ced743e34d2c', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:00:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-986f02c7-7eaa-414f-aa0c-e08b66913afb req-54af8af7-aeab-45b5-a6be-7bb51230cf24 tempest-AttachVolumeTestJSON-461879325 None] attachment_update completed successfully. Sep 05 21:01:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-e8186222-b0d4-41a5-ac92-153f83ea3313 req-ec362125-267f-4382-b854-9db57d893548 tempest-TestInstancesWithCinderVolumes-1431833702 None] Terminate volume connection completed successfully. Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-e8186222-b0d4-41a5-ac92-153f83ea3313 req-ec362125-267f-4382-b854-9db57d893548 tempest-TestInstancesWithCinderVolumes-1431833702 None] Deleting attachment 4852a11c-785b-43a1-a641-b9ba19a9eff3. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Flow 'volume_create_manager' (6bea12ab-9d95-406d-97ec-3cf08ce9489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a2f63f-58bc-4e00-9ac1-f9b334d3bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a2f63f-58bc-4e00-9ac1-f9b334d3bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-97169605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b0f37f62734037b7f8a58eddf1b8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:02Z,use_quota=True,user_id='584fc18d342746cda7d2530167e9c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b389a214-10fa-4760-99d9-f9512bdacf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b389a214-10fa-4760-99d9-f9512bdacf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1b0d50-6215-4f76-a36b-20fcd0edb588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1b0d50-6215-4f76-a36b-20fcd0edb588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab', 'volume_name': 'volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c5caf9-5ee4-4d61-a58f-389593caed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c5caf9-5ee4-4d61-a58f-389593caed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6e2a8d-5364-40ac-bc23-8e897ecedeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Volume a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab', 'volume_size': 1} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-97169605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b0f37f62734037b7f8a58eddf1b8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:02Z,use_quota=True,user_id='584fc18d342746cda7d2530167e9c54f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Creating volume a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:01:02 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:02 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab 1073741824 Sep 05 21:01:02 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:02 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab 1073741824" returned: 0 in 0.578s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab Sep 05 21:01:03 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "cinder-fa9ad43a-7e34-4409-8f78-b363f8422064-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-fa9ad43a-7e34-4409-8f78-b363f8422064-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:03 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab" returned: 0 in 0.346s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6e2a8d-5364-40ac-bc23-8e897ecedeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2818e904-6f46-47dc-9662-562e61ab2498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Volume volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab (a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab): created successfully Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2818e904-6f46-47dc-9662-562e61ab2498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Flow 'volume_create_manager' (6bea12ab-9d95-406d-97ec-3cf08ce9489e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "cinder-quobyte-fa9ad43a-7e34-4409-8f78-b363f8422064" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-33c30fc9-6ef1-4dda-be42-82677e63a276 tempest-AttachVolumeTestJSON-461879325 None] Created volume successfully. Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-quobyte-fa9ad43a-7e34-4409-8f78-b363f8422064" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5c075-bd32-4a72-83d5-181ee590b486]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 Sep 05 21:01:03 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:03 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064" returned: 0 in 0.422s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:03 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064 Sep 05 21:01:03 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fa9ad43a-7e34-4409-8f78-b363f8422064" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-quobyte-fa9ad43a-7e34-4409-8f78-b363f8422064" released by "delete_volume" :: held 0.771s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:04 devstack cinder-volume[87778]: WARNING cinder.quota [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-215611505-1813549215 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-215611505-1813549215, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:01:04 devstack cinder-volume[87778]: WARNING cinder.quota [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-215611505-1813549215 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-215611505-1813549215, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Created reservations ['30985300-212d-44f2-bda5-dd6a73db5abb', '046fe7fd-2cc7-4708-a356-6a993de30557', 'e15ec116-cd43-48b4-ae40-b29081190c31', '0aed957b-d4a9-4f03-bf25-c21ca0bfdc38'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:04 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:01:04 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.378s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Deleted volume successfully. Sep 05 21:01:04 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:01:04 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2fdc72c-6466-4caa-ad1d-07db242a090e tempest-TestInstancesWithCinderVolumes-1431833702 None] Lock "cinder-fa9ad43a-7e34-4409-8f78-b363f8422064-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:05 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-30247304-3a71-4502-a256-b5b097595870 req-043df25a-710b-4f2c-b14d-1218d65ae087 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-30247304-3a71-4502-a256-b5b097595870 req-043df25a-710b-4f2c-b14d-1218d65ae087 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-30247304-3a71-4502-a256-b5b097595870 req-043df25a-710b-4f2c-b14d-1218d65ae087 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-30247304-3a71-4502-a256-b5b097595870 req-043df25a-710b-4f2c-b14d-1218d65ae087 tempest-AttachVolumeTestJSON-461879325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ada5fa4a-671b-421e-b5bf-a562de7ad776', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:01:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-30247304-3a71-4502-a256-b5b097595870 req-043df25a-710b-4f2c-b14d-1218d65ae087 tempest-AttachVolumeTestJSON-461879325 None] attachment_update completed successfully. Sep 05 21:01:08 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-61fc9708-c31b-476b-b371-971454281a63 req-75b4d2eb-0dcf-419e-9287-5a6c693711eb tempest-AttachVolumeTestJSON-461879325 None] Terminate volume connection completed successfully. Sep 05 21:01:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-61fc9708-c31b-476b-b371-971454281a63 req-75b4d2eb-0dcf-419e-9287-5a6c693711eb tempest-AttachVolumeTestJSON-461879325 None] Deleting attachment fe9cda52-05ec-4c3c-9d3f-ced743e34d2c. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:01:10 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-3757ecc8-43ad-4103-b29f-9f0b4c82f029 req-9f79bb37-e784-40dd-83c9-a1958bd04ee5 tempest-AttachVolumeTestJSON-461879325 None] Terminate volume connection completed successfully. Sep 05 21:01:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-3757ecc8-43ad-4103-b29f-9f0b4c82f029 req-9f79bb37-e784-40dd-83c9-a1958bd04ee5 tempest-AttachVolumeTestJSON-461879325 None] Deleting attachment ada5fa4a-671b-421e-b5bf-a562de7ad776. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:01:20 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=57,cinder:UPDATE=43,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:20 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=55,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "cinder-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "cinder-quobyte-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-quobyte-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[698134c4-f8bd-4eb6-adaa-ecbc66b90d9b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:21 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab Sep 05 21:01:21 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:21 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab" returned: 0 in 0.420s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:21 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab Sep 05 21:01:21 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:21 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab" returned: 0 in 0.305s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-quobyte-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab" released by "delete_volume" :: held 0.765s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Created reservations ['9b4a2579-52eb-4348-987e-40df7392c904', '4c888f99-3322-47d8-9bf1-df98e34618bb', 'fa1e9cdc-d5f9-409b-9c68-37945b685372', '9f5930ab-37d5-4ee6-9e18-8cfe6b73234c'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:22 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:01:22 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "cinder-0b1b1028-2b22-4c31-9056-8ef409e8f66f-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-0b1b1028-2b22-4c31-9056-8ef409e8f66f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "cinder-quobyte-0b1b1028-2b22-4c31-9056-8ef409e8f66f" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-quobyte-0b1b1028-2b22-4c31-9056-8ef409e8f66f" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d1a4e3-616e-4ee7-ad2d-7d7e58229459]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:22 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.506s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Deleted volume successfully. Sep 05 21:01:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-febdaa47-b870-46d6-9698-14025b604a4a tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-a5a7b5fb-c82a-4bf1-b246-4c51de1bbcab-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:22 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f Sep 05 21:01:22 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:23 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f" returned: 0 in 0.598s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:23 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f Sep 05 21:01:23 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:23 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0b1b1028-2b22-4c31-9056-8ef409e8f66f" returned: 0 in 0.317s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-quobyte-0b1b1028-2b22-4c31-9056-8ef409e8f66f" released by "delete_volume" :: held 0.981s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Created reservations ['0f498daf-1229-4da2-8647-5669234f952d', '4871f0ac-13c2-4af3-9fc9-08e9d4b98bbc', 'b8516f1f-44d0-4fa9-8a11-1cd740279f9b', '5efbccc3-54bb-4e3b-96ce-f313c622e681'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:23 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:01:23 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:23 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.270s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Deleted volume successfully. Sep 05 21:01:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-449a9dc2-0311-48d0-bad4-da98aa5618bc tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-0b1b1028-2b22-4c31-9056-8ef409e8f66f-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "cinder-4561905f-632b-4dc3-aa74-06e371da45c8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-4561905f-632b-4dc3-aa74-06e371da45c8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "cinder-quobyte-4561905f-632b-4dc3-aa74-06e371da45c8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-quobyte-4561905f-632b-4dc3-aa74-06e371da45c8" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[34301bdd-eb2f-4887-b1bf-af9f7b1d5682]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:24 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 Sep 05 21:01:24 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:25 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8" returned: 0 in 0.480s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:25 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8 Sep 05 21:01:25 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:25 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4561905f-632b-4dc3-aa74-06e371da45c8" returned: 0 in 0.324s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-quobyte-4561905f-632b-4dc3-aa74-06e371da45c8" released by "delete_volume" :: held 0.872s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Created reservations ['e31243f8-ebf9-4dac-8914-2f1565ba8e0a', '0c34c15b-d3e0-4e67-9ac1-dbab4161e539', '3136316c-4792-4b9f-b6f1-c301a4826593', '1453cc53-219a-4d49-9ea3-ce1002cb06d2'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:25 devstack sudo[100081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:01:25 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:26 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.340s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:26 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Deleted volume successfully. Sep 05 21:01:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-02e83d1b-c4d8-4193-a3e2-039bf2fd6db3 tempest-AttachVolumeTestJSON-461879325 None] Lock "cinder-4561905f-632b-4dc3-aa74-06e371da45c8-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=16,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Flow 'volume_create_manager' (54ec167f-98d2-4584-8150-8093633e74db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acfd541-2bc5-4cb3-bb73-8c87001acf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4acfd541-2bc5-4cb3-bb73-8c87001acf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-972560645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e54f878-98ff-4212-85ba-2e06885f13b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e2d4f3f7a3747ad9206153997fd2e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:41Z,use_quota=True,user_id='53ee13efee994ff39d1d8a254d55c34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97505684-ba82-43b4-b4db-4ca91e0322b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97505684-ba82-43b4-b4db-4ca91e0322b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54fdbe0-0bf5-46ad-9590-771cdd8c4e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d54fdbe0-0bf5-46ad-9590-771cdd8c4e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e54f878-98ff-4212-85ba-2e06885f13b8', 'volume_name': 'volume-8e54f878-98ff-4212-85ba-2e06885f13b8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad02340-b122-4ba1-af31-04b667aa8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad02340-b122-4ba1-af31-04b667aa8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff52cfa5-40df-4fc4-9c04-c669c13c8d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Volume 8e54f878-98ff-4212-85ba-2e06885f13b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e54f878-98ff-4212-85ba-2e06885f13b8', 'volume_size': 1} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-972560645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e54f878-98ff-4212-85ba-2e06885f13b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1e2d4f3f7a3747ad9206153997fd2e0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:41Z,use_quota=True,user_id='53ee13efee994ff39d1d8a254d55c34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Creating volume 8e54f878-98ff-4212-85ba-2e06885f13b8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:01:41 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:41 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 1073741824 Sep 05 21:01:41 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:41 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 1073741824" returned: 0 in 0.587s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:42 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 Sep 05 21:01:42 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:42 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8" returned: 0 in 0.287s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff52cfa5-40df-4fc4-9c04-c669c13c8d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e54f878-98ff-4212-85ba-2e06885f13b8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f744a9ad-e951-4975-a92a-c5ffed7a9779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:42 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Volume volume-8e54f878-98ff-4212-85ba-2e06885f13b8 (8e54f878-98ff-4212-85ba-2e06885f13b8): created successfully Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f744a9ad-e951-4975-a92a-c5ffed7a9779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Flow 'volume_create_manager' (54ec167f-98d2-4584-8150-8093633e74db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-7f52f1c3-14ba-4539-9ce1-4b92ed0d4a83 req-c1efa9c0-1858-4c05-89cb-2fdf2a0b7f04 tempest-VolumesGetTestJSON-11379755 None] Created volume successfully. Sep 05 21:01:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Acquiring lock "cinder-8e54f878-98ff-4212-85ba-2e06885f13b8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Lock "cinder-8e54f878-98ff-4212-85ba-2e06885f13b8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Acquiring lock "cinder-quobyte-8e54f878-98ff-4212-85ba-2e06885f13b8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:01:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Lock "cinder-quobyte-8e54f878-98ff-4212-85ba-2e06885f13b8" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:01:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc156ba6-5e59-4f34-8d1e-0e7ed2c22c7c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:01:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:44 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 Sep 05 21:01:44 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:44 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8" returned: 0 in 0.725s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:44 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8 Sep 05 21:01:44 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:44 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e54f878-98ff-4212-85ba-2e06885f13b8" returned: 0 in 0.278s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Lock "cinder-quobyte-8e54f878-98ff-4212-85ba-2e06885f13b8" released by "delete_volume" :: held 1.069s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG cinder.quota [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Created reservations ['bf0a1d95-78ef-4417-940d-ae7e67700264', 'f1c2c13e-029a-491c-892f-80ea08caa70a', '5740ef34-0917-42b9-b22c-9f76f25c665d', '20ed500b-6d96-41ff-8470-9a144de9b082'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:45 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:01:45 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:45 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.353s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG cinder.manager [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:01:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Deleted volume successfully. Sep 05 21:01:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-85b0cd7f-59cc-49b6-b52d-00495c4b808d req-85042d8b-a785-425f-b08c-00a293e67a61 tempest-VolumesGetTestJSON-11379755 None] Lock "cinder-8e54f878-98ff-4212-85ba-2e06885f13b8-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Flow 'volume_create_manager' (733adf7c-1e9e-4ebc-850f-d63b250351f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0056c-8540-4432-8535-8f5d91e68e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0056c-8540-4432-8535-8f5d91e68e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-727546175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4925e491-06c1-44e7-b6a4-ff26d2692ed2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e543ca48c69d40f981f12fcedfe6df26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:53Z,use_quota=True,user_id='f3d0e252d6a243738c0edc5f36cb8d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff8ba36-ed4d-4d60-b063-6d021944e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff8ba36-ed4d-4d60-b063-6d021944e231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d888e5f-eab6-4f5f-8a74-6d3877219f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d888e5f-eab6-4f5f-8a74-6d3877219f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4925e491-06c1-44e7-b6a4-ff26d2692ed2', 'volume_name': 'volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae5848-9ad8-454d-9f6e-b89100a94b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ae5848-9ad8-454d-9f6e-b89100a94b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1e5790-0911-423e-94e1-d14fc1e375ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:53 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Volume 4925e491-06c1-44e7-b6a4-ff26d2692ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2', 'volume_size': 1} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-727546175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4925e491-06c1-44e7-b6a4-ff26d2692ed2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e543ca48c69d40f981f12fcedfe6df26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:53Z,use_quota=True,user_id='f3d0e252d6a243738c0edc5f36cb8d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Creating volume 4925e491-06c1-44e7-b6a4-ff26d2692ed2 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:01:53 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:53 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 1073741824 Sep 05 21:01:53 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:53 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 1073741824" returned: 0 in 0.603s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:53 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 Sep 05 21:01:53 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:54 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2" returned: 0 in 0.311s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1e5790-0911-423e-94e1-d14fc1e375ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a223168-2a19-4470-afcb-8a213639fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:54 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Volume volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 (4925e491-06c1-44e7-b6a4-ff26d2692ed2): created successfully Sep 05 21:01:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a223168-2a19-4470-afcb-8a213639fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Flow 'volume_create_manager' (733adf7c-1e9e-4ebc-850f-d63b250351f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ba291ada-68d7-433e-90aa-aa4fd5e60f3a tempest-VolumesTestJSON-1892200920 None] Created volume successfully. Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Flow 'volume_create_manager' (2cb63ce4-647c-4237-a667-51bf8279ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07fc911-6cca-46ab-a2a5-75b73d007e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07fc911-6cca-46ab-a2a5-75b73d007e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1477412595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a6b4a-72bf-4686-a2fd-27adc439e9b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e543ca48c69d40f981f12fcedfe6df26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:56Z,use_quota=True,user_id='f3d0e252d6a243738c0edc5f36cb8d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ee2ac3-7673-4c1d-9677-5ca9fa121fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ee2ac3-7673-4c1d-9677-5ca9fa121fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970e7109-4813-44d1-89b3-9a30de6064e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970e7109-4813-44d1-89b3-9a30de6064e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761a6b4a-72bf-4686-a2fd-27adc439e9b5', 'volume_name': 'volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490bc574-7dd3-45c4-b2ba-3333e90b79db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490bc574-7dd3-45c4-b2ba-3333e90b79db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60456d5-a40e-413a-8a27-a6007daa7700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:56 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Volume 761a6b4a-72bf-4686-a2fd-27adc439e9b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5', 'volume_size': 1} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1477412595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761a6b4a-72bf-4686-a2fd-27adc439e9b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e543ca48c69d40f981f12fcedfe6df26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:56Z,use_quota=True,user_id='f3d0e252d6a243738c0edc5f36cb8d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Creating volume 761a6b4a-72bf-4686-a2fd-27adc439e9b5 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:01:56 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:56 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 1073741824 Sep 05 21:01:56 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:56 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 1073741824" returned: 0 in 0.623s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:57 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 Sep 05 21:01:57 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:57 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60456d5-a40e-413a-8a27-a6007daa7700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2336479c-8517-45a5-91db-2296d4c0d4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:57 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Volume volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 (761a6b4a-72bf-4686-a2fd-27adc439e9b5): created successfully Sep 05 21:01:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2336479c-8517-45a5-91db-2296d4c0d4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:57 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Flow 'volume_create_manager' (2cb63ce4-647c-4237-a667-51bf8279ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0375be53-4f43-4988-9af3-19c79244f73c tempest-VolumesTestJSON-1892200920 None] Created volume successfully. Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Flow 'volume_create_manager' (d0b2e5ba-2673-4ba5-9c8a-47307147af19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca0e4c3-d575-4777-84a6-7d9a8d975dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca0e4c3-d575-4777-84a6-7d9a8d975dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1890466934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e543ca48c69d40f981f12fcedfe6df26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:59Z,use_quota=True,user_id='f3d0e252d6a243738c0edc5f36cb8d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8660dbe1-55e4-4a18-a534-0d388cfbeeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8660dbe1-55e4-4a18-a534-0d388cfbeeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f4ac69-1556-48d6-b2ab-5175d2ba0046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f4ac69-1556-48d6-b2ab-5175d2ba0046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34', 'volume_name': 'volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af86b3d-eee2-4577-b3a4-833e409e1ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af86b3d-eee2-4577-b3a4-833e409e1ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec7003d-2263-4cb0-8b53-bd48e76e162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Volume 44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34', 'volume_size': 1} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1890466934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e543ca48c69d40f981f12fcedfe6df26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:01:59Z,use_quota=True,user_id='f3d0e252d6a243738c0edc5f36cb8d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Creating volume 44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:01:59 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:59 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 1073741824 Sep 05 21:01:59 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:59 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 1073741824" returned: 0 in 0.508s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:01:59 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 Sep 05 21:01:59 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:01:59 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34" returned: 0 in 0.272s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec7003d-2263-4cb0-8b53-bd48e76e162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b54b482-2575-4648-b2f6-f077291dc962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:01:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Volume volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 (44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34): created successfully Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b54b482-2575-4648-b2f6-f077291dc962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:01:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Flow 'volume_create_manager' (d0b2e5ba-2673-4ba5-9c8a-47307147af19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:01:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b24da3de-19e6-4cec-9204-35fb69d9d365 tempest-VolumesTestJSON-1892200920 None] Created volume successfully. Sep 05 21:02:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "cinder-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "cinder-quobyte-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-quobyte-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb81a9b8-3f9f-4d2b-918d-272b67ad9e49]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Flow 'volume_create_manager' (f0b7577e-c392-4a76-b1ee-f96b8675f416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3a63a3-7062-4c0a-a2aa-2cde11057f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3a63a3-7062-4c0a-a2aa-2cde11057f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-293107206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2361a5-7615-45ac-9d4e-0b4b23dae504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd99d93dd2841449b6784793884284f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:02Z,use_quota=True,user_id='334155249b6540228ad191bd43aed2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ef9b10-13a2-4f8b-bdb5-aa1ba31cef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ef9b10-13a2-4f8b-bdb5-aa1ba31cef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76ea1fc-b002-46ed-8f49-29a234cf7af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76ea1fc-b002-46ed-8f49-29a234cf7af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2361a5-7615-45ac-9d4e-0b4b23dae504', 'volume_name': 'volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d948e26-8e44-45bb-9ff4-a7a393d3beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d948e26-8e44-45bb-9ff4-a7a393d3beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09f37d4-278c-44bf-905f-a2987d114f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Volume fb2361a5-7615-45ac-9d4e-0b4b23dae504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504', 'volume_size': 1} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-293107206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2361a5-7615-45ac-9d4e-0b4b23dae504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd99d93dd2841449b6784793884284f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:02Z,use_quota=True,user_id='334155249b6540228ad191bd43aed2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Creating volume fb2361a5-7615-45ac-9d4e-0b4b23dae504 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:02:02 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:02 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 Sep 05 21:02:02 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:02 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 1073741824 Sep 05 21:02:02 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:02 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34" returned: 0 in 0.527s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:02 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34 Sep 05 21:02:02 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Flow 'volume_create_manager' (59f02bb6-5016-4ed5-9a04-984cb40f7f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696ae101-79ea-48d7-ba40-780855e6608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696ae101-79ea-48d7-ba40-780855e6608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1612044892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb923359-9709-4ce9-911a-b51e257eafd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd99d93dd2841449b6784793884284f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:03Z,use_quota=True,user_id='334155249b6540228ad191bd43aed2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4130b0-13c8-4c45-aa06-7a753b18fc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4130b0-13c8-4c45-aa06-7a753b18fc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e9db1c-4ea0-460b-a243-76cdc7b1a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e9db1c-4ea0-460b-a243-76cdc7b1a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb923359-9709-4ce9-911a-b51e257eafd8', 'volume_name': 'volume-cb923359-9709-4ce9-911a-b51e257eafd8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a8aad-4cc2-4366-a808-e1752bc5d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a8aad-4cc2-4366-a808-e1752bc5d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd1aa5c-8da4-4531-9980-1aa3b7b33191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Volume cb923359-9709-4ce9-911a-b51e257eafd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb923359-9709-4ce9-911a-b51e257eafd8', 'volume_size': 1} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:02 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 1073741824" returned: 0 in 0.623s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:02 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34" returned: 0 in 0.348s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:02 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 Sep 05 21:02:02 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-quobyte-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34" released by "delete_volume" :: held 0.937s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Created reservations ['50158d5c-6ea7-4b90-b38a-64150e9efd8b', '5c2af28b-311b-425e-8e9b-573a41fd0f87', 'ec39a366-4215-4c5c-89cb-4bdb9f490a4d', 'bfb89239-4df0-47ca-953c-d77e82f16075'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:03 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:03 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:03 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504" returned: 0 in 0.334s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1612044892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb923359-9709-4ce9-911a-b51e257eafd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd99d93dd2841449b6784793884284f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:03Z,use_quota=True,user_id='334155249b6540228ad191bd43aed2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Creating volume cb923359-9709-4ce9-911a-b51e257eafd8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:02:03 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f09f37d4-278c-44bf-905f-a2987d114f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca041d8-35a8-4f46-9d7b-188a4df567a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:03 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 1073741824 Sep 05 21:02:03 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Volume volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 (fb2361a5-7615-45ac-9d4e-0b4b23dae504): created successfully Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca041d8-35a8-4f46-9d7b-188a4df567a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Flow 'volume_create_manager' (f0b7577e-c392-4a76-b1ee-f96b8675f416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1da0fa6a-0cef-406c-970c-f51bcb58904c tempest-TestServerVolumeAttachmentScenario-245042391 None] Created volume successfully. Sep 05 21:02:03 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Deleted volume successfully. Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-76159a91-d51b-429d-bbcc-76fe3a31c531 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-44b673d1-e6b1-4c5d-bc4d-b9f1fb829e34-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:03 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 1073741824" returned: 0 in 0.515s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:03 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 Sep 05 21:02:03 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:04 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd1aa5c-8da4-4531-9980-1aa3b7b33191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb923359-9709-4ce9-911a-b51e257eafd8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d76854-e8e6-4146-a494-734cc1972f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:04 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Volume volume-cb923359-9709-4ce9-911a-b51e257eafd8 (cb923359-9709-4ce9-911a-b51e257eafd8): created successfully Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d76854-e8e6-4146-a494-734cc1972f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Flow 'volume_create_manager' (59f02bb6-5016-4ed5-9a04-984cb40f7f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4d66d2d1-1032-4363-ad86-b3fbe73d5213 tempest-TestServerVolumeAttachmentScenario-245042391 None] Created volume successfully. Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "cinder-761a6b4a-72bf-4686-a2fd-27adc439e9b5-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-761a6b4a-72bf-4686-a2fd-27adc439e9b5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "cinder-quobyte-761a6b4a-72bf-4686-a2fd-27adc439e9b5" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-quobyte-761a6b4a-72bf-4686-a2fd-27adc439e9b5" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e5281d-fd86-4bb7-9a8b-6a8721acf09e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:04 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 Sep 05 21:02:04 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:04 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5" returned: 0 in 0.418s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:04 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5 Sep 05 21:02:04 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:04 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:04 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:05 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-761a6b4a-72bf-4686-a2fd-27adc439e9b5" returned: 0 in 0.322s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-quobyte-761a6b4a-72bf-4686-a2fd-27adc439e9b5" released by "delete_volume" :: held 0.799s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:05 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Created reservations ['278c06ce-8228-4912-9b7b-e00139cff077', 'e07796db-9104-44ad-a9bf-ab2880a50cb0', '72001f5f-51f2-4761-ba16-faccf80e5714', '621cda5e-4a71-46e5-9967-cc5671264002'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:05 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:05 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Acquiring lock "cinder-4925e491-06c1-44e7-b6a4-ff26d2692ed2-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Lock "cinder-4925e491-06c1-44e7-b6a4-ff26d2692ed2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Acquiring lock "cinder-quobyte-4925e491-06c1-44e7-b6a4-ff26d2692ed2" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Lock "cinder-quobyte-4925e491-06c1-44e7-b6a4-ff26d2692ed2" acquired by "delete_volume" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed47583-802d-4e4a-9b67-5e4e354279fc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:05 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.377s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Deleted volume successfully. Sep 05 21:02:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce4acf63-7f9d-4b10-8cd7-a5fd9cf12c35 tempest-VolumesTestJSON-1892200920 None] Lock "cinder-761a6b4a-72bf-4686-a2fd-27adc439e9b5-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:05 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 Sep 05 21:02:05 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:06 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2" returned: 0 in 0.451s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:06 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2 Sep 05 21:02:06 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:06 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4925e491-06c1-44e7-b6a4-ff26d2692ed2" returned: 0 in 0.292s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Lock "cinder-quobyte-4925e491-06c1-44e7-b6a4-ff26d2692ed2" released by "delete_volume" :: held 0.803s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Created reservations ['de6abb6f-f91a-4655-ba89-0987a3613efb', '0f529382-3697-4864-9ce6-20229db98343', '3359606e-a08a-47b0-9bb5-1d66362b4f12', '7eda37ec-54dd-4610-ac1e-20bf0fd49a5f'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:06 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:06 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:07 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.373s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:07 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Deleted volume successfully. Sep 05 21:02:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-792fe0e6-36cc-4247-b1ba-a9be4228c48b tempest-VolumesTestJSON-1892200920 None] Lock "cinder-4925e491-06c1-44e7-b6a4-ff26d2692ed2-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Flow 'volume_create_manager' (abbc35eb-ab51-4ad4-95a5-f2103542f253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20604a9-f9da-440d-ba1d-bc255e1b87ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20604a9-f9da-440d-ba1d-bc255e1b87ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-10168105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9c3967-3535-48db-9f7c-e08087c2518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ee3020bc2b41fca773fab5d038cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:10Z,use_quota=True,user_id='5bb20af673134e8ea264914df5afd028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4d98a2-7a78-409a-8d4b-64c465ea812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4d98a2-7a78-409a-8d4b-64c465ea812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ba3840-5282-4efc-b15b-7719ca59166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ba3840-5282-4efc-b15b-7719ca59166d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9c3967-3535-48db-9f7c-e08087c2518e', 'volume_name': 'volume-4f9c3967-3535-48db-9f7c-e08087c2518e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0c77e8-2110-42c9-a18d-83ae4140e5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0c77e8-2110-42c9-a18d-83ae4140e5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2b8441-b87a-44ad-b64a-c1400f84ab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:10 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Volume 4f9c3967-3535-48db-9f7c-e08087c2518e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9c3967-3535-48db-9f7c-e08087c2518e', 'volume_size': 1} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-10168105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9c3967-3535-48db-9f7c-e08087c2518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2ee3020bc2b41fca773fab5d038cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:10Z,use_quota=True,user_id='5bb20af673134e8ea264914df5afd028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Creating volume 4f9c3967-3535-48db-9f7c-e08087c2518e {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:02:10 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:02:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:10 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e 1073741824 Sep 05 21:02:10 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:11 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e 1073741824" returned: 0 in 0.902s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:11 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e Sep 05 21:02:11 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:11 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e" returned: 0 in 0.439s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2b8441-b87a-44ad-b64a-c1400f84ab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9c3967-3535-48db-9f7c-e08087c2518e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599f4fa5-aef6-4ca1-9cbb-dc562a26f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Volume volume-4f9c3967-3535-48db-9f7c-e08087c2518e (4f9c3967-3535-48db-9f7c-e08087c2518e): created successfully Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599f4fa5-aef6-4ca1-9cbb-dc562a26f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Flow 'volume_create_manager' (abbc35eb-ab51-4ad4-95a5-f2103542f253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ee9f4547-3b2c-4732-9b2a-8dfc37e5bdd1 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Created volume successfully. Sep 05 21:02:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7eb7dc4a-5ce4-4226-85a5-e217f2b48322 req-1ac58dec-6ad4-4aa6-8bb2-711ea08cf49e tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7eb7dc4a-5ce4-4226-85a5-e217f2b48322 req-1ac58dec-6ad4-4aa6-8bb2-711ea08cf49e tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-7eb7dc4a-5ce4-4226-85a5-e217f2b48322 req-1ac58dec-6ad4-4aa6-8bb2-711ea08cf49e tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-7eb7dc4a-5ce4-4226-85a5-e217f2b48322 req-1ac58dec-6ad4-4aa6-8bb2-711ea08cf49e tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-4f9c3967-3535-48db-9f7c-e08087c2518e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fed4a00c-f542-4880-ac3c-71ac36424e7a', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:02:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-7eb7dc4a-5ce4-4226-85a5-e217f2b48322 req-1ac58dec-6ad4-4aa6-8bb2-711ea08cf49e tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] attachment_update completed successfully. Sep 05 21:02:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-bf32fbbb-ec2c-4835-a012-d4d475a89fac req-ae1f0262-c264-4826-b196-3eb522358984 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Terminate volume connection completed successfully. Sep 05 21:02:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-bf32fbbb-ec2c-4835-a012-d4d475a89fac req-ae1f0262-c264-4826-b196-3eb522358984 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Deleting attachment fed4a00c-f542-4880-ac3c-71ac36424e7a. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:02:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Acquiring lock "cinder-4f9c3967-3535-48db-9f7c-e08087c2518e-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "cinder-4f9c3967-3535-48db-9f7c-e08087c2518e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Acquiring lock "cinder-quobyte-4f9c3967-3535-48db-9f7c-e08087c2518e" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "cinder-quobyte-4f9c3967-3535-48db-9f7c-e08087c2518e" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d19938-2101-4e2d-bb0e-d7cb6b9d807a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:19 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e Sep 05 21:02:19 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:19 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e" returned: 0 in 0.413s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:19 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e Sep 05 21:02:19 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:19 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4f9c3967-3535-48db-9f7c-e08087c2518e" returned: 0 in 0.278s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "cinder-quobyte-4f9c3967-3535-48db-9f7c-e08087c2518e" released by "delete_volume" :: held 0.774s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Created reservations ['17b94379-b854-4f97-b1ec-7c0d4de5a1ec', '2abd6f24-222b-4487-ba1b-31410457e119', '4c673c72-ca77-4a21-a438-3f9aa491f04b', 'dda3b4c9-88d5-43d7-92a3-0412a41396a7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:19 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:19 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:20 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.394s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:20 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Deleted volume successfully. Sep 05 21:02:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fd607e92-cb95-4420-8359-0db36956c9f4 tempest-TestServerVolumeAttachScenarioOldVersion-340322533 None] Lock "cinder-4f9c3967-3535-48db-9f7c-e08087c2518e-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b0485a1c-3342-4473-8803-be3af062a0a7 tempest-GroupsTest-1350833272 None] Group tempest-Group1-1812072992: creating Sep 05 21:02:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b0485a1c-3342-4473-8803-be3af062a0a7 tempest-GroupsTest-1350833272 None] Group tempest-Group1-1812072992: created successfully Sep 05 21:02:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b0485a1c-3342-4473-8803-be3af062a0a7 tempest-GroupsTest-1350833272 None] Create group completed successfully. Sep 05 21:02:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a0d8adfe-4246-41dd-a192-005c2275cb51 tempest-GroupsTest-1350833272 None] Group tempest-Group2-1476832206: creating Sep 05 21:02:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a0d8adfe-4246-41dd-a192-005c2275cb51 tempest-GroupsTest-1350833272 None] Group tempest-Group2-1476832206: created successfully Sep 05 21:02:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a0d8adfe-4246-41dd-a192-005c2275cb51 tempest-GroupsTest-1350833272 None] Create group completed successfully. Sep 05 21:02:24 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Flow 'volume_create_manager' (78ac2ed9-f080-4c1d-aa6c-fe69beb7ee0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff6ab59-dedd-4146-8a16-2368ec2492d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff6ab59-dedd-4146-8a16-2368ec2492d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394262488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62130a1e-956d-4475-ad84-7c820c816f3f,host='devstack@QuobyteHD#QuobyteHD',id=fc503c7d-3667-481c-a8a7-4f0f9b4b0d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbb5f0499a549a0bccdbd8f577fd69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:25Z,use_quota=True,user_id='8867e806ab8041858c1d93aba7ae8134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fd4cd-b2db-44ae-8c56-83420da45876),volume_type_id=bb5fd4cd-b2db-44ae-8c56-83420da45876)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea3413c-8345-4665-9a43-70f435569ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea3413c-8345-4665-9a43-70f435569ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83809698-7825-451a-a08b-bb1b007a9008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83809698-7825-451a-a08b-bb1b007a9008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc503c7d-3667-481c-a8a7-4f0f9b4b0d37', 'volume_name': 'volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6c0caa-cf1f-4a83-933b-36295e951a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6c0caa-cf1f-4a83-933b-36295e951a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea46ff-3ce3-48f7-b580-8c8d58049091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:25 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Volume fc503c7d-3667-481c-a8a7-4f0f9b4b0d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37', 'volume_size': 1} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62130a1e-956d-4475-ad84-7c820c816f3f,created_at=2026-09-05T19:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1394262488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62130a1e-956d-4475-ad84-7c820c816f3f,host='devstack@QuobyteHD#QuobyteHD',id=fc503c7d-3667-481c-a8a7-4f0f9b4b0d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbb5f0499a549a0bccdbd8f577fd69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:25Z,use_quota=True,user_id='8867e806ab8041858c1d93aba7ae8134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5fd4cd-b2db-44ae-8c56-83420da45876),volume_type_id=bb5fd4cd-b2db-44ae-8c56-83420da45876)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Creating volume fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:02:25 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:25 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 1073741824 Sep 05 21:02:25 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:25 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 1073741824" returned: 0 in 0.511s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:25 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 Sep 05 21:02:25 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:25 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea46ff-3ce3-48f7-b580-8c8d58049091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5e3ba0-786c-431c-8818-dd7ca11d8730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:25 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Volume volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 (fc503c7d-3667-481c-a8a7-4f0f9b4b0d37): created successfully Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5e3ba0-786c-431c-8818-dd7ca11d8730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Flow 'volume_create_manager' (78ac2ed9-f080-4c1d-aa6c-fe69beb7ee0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6c1789d6-5fbe-4b4f-b00a-0d03951a7e16 tempest-GroupsTest-1350833272 None] Created volume successfully. Sep 05 21:02:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Acquiring lock "cinder-quobyte-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Lock "cinder-quobyte-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:26 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3ad3cc-3dc0-41a3-8551-6f9fb3ad55a3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:26 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 Sep 05 21:02:26 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:27 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37" returned: 0 in 0.418s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:27 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37 Sep 05 21:02:27 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:27 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37" returned: 0 in 0.254s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Lock "cinder-quobyte-fc503c7d-3667-481c-a8a7-4f0f9b4b0d37" released by "delete_volume" :: held 0.732s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Created reservations ['e350e800-5772-43ab-a626-a0839c1395c5'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:27 devstack cinder-volume[87778]: WARNING cinder.quota [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-403722075 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-403722075, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:02:27 devstack cinder-volume[87778]: WARNING cinder.quota [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-403722075 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-403722075, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Created reservations ['4dbc40fa-86b2-48a1-aef1-8cdc90c542c2', '005ac868-35bd-45c9-978f-ea0abf25cd0c', 'e8a49c3d-a1a7-4337-a8a5-a9b99f9a4cde', '5c89235a-1443-45c4-94ae-1dbb17540558'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:27 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:27 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:28 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.292s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-03cf6f39-5acc-4626-aa31-9f24b9366f70 tempest-GroupsTest-1350833272 None] Delete group completed successfully. Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Created reservations ['d885dc3c-6f4a-4bc8-8e28-baa0dd437e79'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:28 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:28 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:28 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.273s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:28 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f64f3ef3-63f4-490c-9489-9e40a1104322 tempest-GroupsTest-1350833272 None] Delete group completed successfully. Sep 05 21:02:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e231db53-ba56-4a9a-baf9-a970d7393d46 tempest-GroupsTest-1350833272 None] Group tempest-GroupsTest-Group-903109192: creating Sep 05 21:02:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e231db53-ba56-4a9a-baf9-a970d7393d46 tempest-GroupsTest-1350833272 None] Group tempest-GroupsTest-Group-903109192: created successfully Sep 05 21:02:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e231db53-ba56-4a9a-baf9-a970d7393d46 tempest-GroupsTest-1350833272 None] Create group completed successfully. Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Flow 'volume_create_manager' (b7459d03-df3c-4120-923e-72cb81923de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcf6a0c-2bcf-41a4-8257-c8b0a991d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcf6a0c-2bcf-41a4-8257-c8b0a991d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-807968375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f910dc4-9f0a-4164-9cec-831dae570126,host='devstack@QuobyteHD#QuobyteHD',id=733e952f-8e66-4ab2-8973-63c4ba29e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbb5f0499a549a0bccdbd8f577fd69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:31Z,use_quota=True,user_id='8867e806ab8041858c1d93aba7ae8134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65bc5607-9fb4-4840-bb04-18ad0b3e72f7),volume_type_id=65bc5607-9fb4-4840-bb04-18ad0b3e72f7)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbda4487-315d-4ab6-95cf-a01e722871c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbda4487-315d-4ab6-95cf-a01e722871c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d283a55a-b50a-4613-8dea-672838151e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d283a55a-b50a-4613-8dea-672838151e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733e952f-8e66-4ab2-8973-63c4ba29e2c0', 'volume_name': 'volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a0413c-f085-424a-b92e-3fd43f441682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a0413c-f085-424a-b92e-3fd43f441682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be3a1ba-4850-45da-994b-0378a225cb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:31 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Volume 733e952f-8e66-4ab2-8973-63c4ba29e2c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0', 'volume_size': 1} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f910dc4-9f0a-4164-9cec-831dae570126,created_at=2026-09-05T19:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-807968375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f910dc4-9f0a-4164-9cec-831dae570126,host='devstack@QuobyteHD#QuobyteHD',id=733e952f-8e66-4ab2-8973-63c4ba29e2c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbb5f0499a549a0bccdbd8f577fd69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:31Z,use_quota=True,user_id='8867e806ab8041858c1d93aba7ae8134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65bc5607-9fb4-4840-bb04-18ad0b3e72f7),volume_type_id=65bc5607-9fb4-4840-bb04-18ad0b3e72f7)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Creating volume 733e952f-8e66-4ab2-8973-63c4ba29e2c0 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:02:31 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:02:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:31 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 1073741824 Sep 05 21:02:31 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:32 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 1073741824" returned: 0 in 0.559s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:32 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 Sep 05 21:02:32 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:32 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0" returned: 0 in 0.306s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be3a1ba-4850-45da-994b-0378a225cb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fff0414-8dd5-44ee-bb3e-7e7241dbd0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Volume volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 (733e952f-8e66-4ab2-8973-63c4ba29e2c0): created successfully Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fff0414-8dd5-44ee-bb3e-7e7241dbd0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Flow 'volume_create_manager' (b7459d03-df3c-4120-923e-72cb81923de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-23194862-067c-471f-9703-574ed2eb31bd tempest-GroupsTest-1350833272 None] Created volume successfully. Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Flow 'volume_create_manager' (b138ec24-7e9d-4723-baa1-7631501c8ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dae0ba-fca1-47c5-aecd-9381e3ff3e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dae0ba-fca1-47c5-aecd-9381e3ff3e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727793703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f910dc4-9f0a-4164-9cec-831dae570126,host='devstack@QuobyteHD#QuobyteHD',id=ad792b01-7a85-457e-b8eb-00a5eab46366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbb5f0499a549a0bccdbd8f577fd69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:34Z,use_quota=True,user_id='8867e806ab8041858c1d93aba7ae8134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65bc5607-9fb4-4840-bb04-18ad0b3e72f7),volume_type_id=65bc5607-9fb4-4840-bb04-18ad0b3e72f7)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f697bf8-e508-4c01-b2ef-2f6909bc7b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f697bf8-e508-4c01-b2ef-2f6909bc7b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ce1ca8-5b0c-46c1-845e-ae6a12e80bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ce1ca8-5b0c-46c1-845e-ae6a12e80bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad792b01-7a85-457e-b8eb-00a5eab46366', 'volume_name': 'volume-ad792b01-7a85-457e-b8eb-00a5eab46366', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d749f-d50f-4af2-861e-f5f9d0bca177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29d749f-d50f-4af2-861e-f5f9d0bca177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dbe0ad-214b-43cf-a0b4-d900ed5ceef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Volume ad792b01-7a85-457e-b8eb-00a5eab46366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad792b01-7a85-457e-b8eb-00a5eab46366', 'volume_size': 1} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f910dc4-9f0a-4164-9cec-831dae570126,created_at=2026-09-05T19:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-727793703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f910dc4-9f0a-4164-9cec-831dae570126,host='devstack@QuobyteHD#QuobyteHD',id=ad792b01-7a85-457e-b8eb-00a5eab46366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afbb5f0499a549a0bccdbd8f577fd69f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:02:34Z,use_quota=True,user_id='8867e806ab8041858c1d93aba7ae8134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65bc5607-9fb4-4840-bb04-18ad0b3e72f7),volume_type_id=65bc5607-9fb4-4840-bb04-18ad0b3e72f7)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Creating volume ad792b01-7a85-457e-b8eb-00a5eab46366 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:02:33 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:02:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:33 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 1073741824 Sep 05 21:02:33 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:34 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 1073741824" returned: 0 in 0.554s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:34 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 Sep 05 21:02:34 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:34 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366" returned: 0 in 0.272s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dbe0ad-214b-43cf-a0b4-d900ed5ceef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad792b01-7a85-457e-b8eb-00a5eab46366', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cc7134-19b8-4729-9fad-53365b5de828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:02:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Volume volume-ad792b01-7a85-457e-b8eb-00a5eab46366 (ad792b01-7a85-457e-b8eb-00a5eab46366): created successfully Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cc7134-19b8-4729-9fad-53365b5de828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:02:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Flow 'volume_create_manager' (b138ec24-7e9d-4723-baa1-7631501c8ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:02:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4bd23de1-2bc5-4112-892b-ee8ba3c2921d tempest-GroupsTest-1350833272 None] Created volume successfully. Sep 05 21:02:35 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-63993651-ff47-4ff7-87b9-85cc7c10b17c tempest-GroupsTest-1350833272 None] Update group completed successfully. Sep 05 21:02:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d704d33f-bccb-4e3a-8235-9ac4844653f2 tempest-GroupsTest-1350833272 None] Update group completed successfully. Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=93,cinder:SELECT=71,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=80,cinder:INSERT=18,cinder:UPDATE=86,cinder:DELETE=7 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4871cb46-2d9c-4ad0-9e44-9df24401b652 req-45a11ae6-3e28-41c3-9e1d-8071afb7cf94 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4871cb46-2d9c-4ad0-9e44-9df24401b652 req-45a11ae6-3e28-41c3-9e1d-8071afb7cf94 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4871cb46-2d9c-4ad0-9e44-9df24401b652 req-45a11ae6-3e28-41c3-9e1d-8071afb7cf94 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-4871cb46-2d9c-4ad0-9e44-9df24401b652 req-45a11ae6-3e28-41c3-9e1d-8071afb7cf94 tempest-TestServerVolumeAttachmentScenario-245042391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3dda359-377c-4217-bbda-0fe600704462', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:02:38 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-4871cb46-2d9c-4ad0-9e44-9df24401b652 req-45a11ae6-3e28-41c3-9e1d-8071afb7cf94 tempest-TestServerVolumeAttachmentScenario-245042391 None] attachment_update completed successfully. Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Acquiring lock "cinder-quobyte-733e952f-8e66-4ab2-8973-63c4ba29e2c0" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Lock "cinder-quobyte-733e952f-8e66-4ab2-8973-63c4ba29e2c0" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85084b-5e30-4ad1-8176-cbd636a2cd67]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:38 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 Sep 05 21:02:38 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:39 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0" returned: 0 in 0.646s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:39 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0 Sep 05 21:02:39 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:39 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-733e952f-8e66-4ab2-8973-63c4ba29e2c0" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Lock "cinder-quobyte-733e952f-8e66-4ab2-8973-63c4ba29e2c0" released by "delete_volume" :: held 1.049s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Acquiring lock "cinder-quobyte-ad792b01-7a85-457e-b8eb-00a5eab46366" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Lock "cinder-quobyte-ad792b01-7a85-457e-b8eb-00a5eab46366" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4b5467-475c-4ac7-a573-df10d90256bb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:39 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 Sep 05 21:02:39 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:40 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366" returned: 0 in 0.408s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:40 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366 Sep 05 21:02:40 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:40 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ad792b01-7a85-457e-b8eb-00a5eab46366" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Lock "cinder-quobyte-ad792b01-7a85-457e-b8eb-00a5eab46366" released by "delete_volume" :: held 0.759s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Created reservations ['39574e1d-9ba5-4473-96b6-3771503ecd89'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:40 devstack cinder-volume[87778]: WARNING cinder.quota [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-746614894 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-746614894, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:02:40 devstack cinder-volume[87778]: WARNING cinder.quota [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-746614894 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-746614894, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Created reservations ['a77e0328-1c83-442b-8b40-57f66f058f12', '1f604724-7814-4988-af61-fe61ff112dad', '558b11e5-17a7-464d-8436-a359076a5127', '673fe922-637e-4c66-92e1-d6f952c1c7d0'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Created reservations ['c8ebff3b-701e-470c-84ad-90409c6609bc', '6ceadace-016f-4770-935e-bd1107c3b064', '40a788ca-16a4-42f7-85a0-d61bb52d9ab1', 'ba244946-a52b-4d8b-95eb-28ece9eec7e6'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:40 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:40 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:41 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.308s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:41 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:41 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3f580647-91db-4869-80ee-92b219097fec tempest-GroupsTest-1350833272 None] Delete group completed successfully. Sep 05 21:02:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4bafbed8-089b-44c7-acab-7b129d83b7f1 req-986376d7-f603-45e6-9e18-223503911ab1 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4bafbed8-089b-44c7-acab-7b129d83b7f1 req-986376d7-f603-45e6-9e18-223503911ab1 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-4bafbed8-089b-44c7-acab-7b129d83b7f1 req-986376d7-f603-45e6-9e18-223503911ab1 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-4bafbed8-089b-44c7-acab-7b129d83b7f1 req-986376d7-f603-45e6-9e18-223503911ab1 tempest-TestServerVolumeAttachmentScenario-245042391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-cb923359-9709-4ce9-911a-b51e257eafd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e4866e9-3272-4527-b228-10310a78f636', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:02:44 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-4bafbed8-089b-44c7-acab-7b129d83b7f1 req-986376d7-f603-45e6-9e18-223503911ab1 tempest-TestServerVolumeAttachmentScenario-245042391 None] attachment_update completed successfully. Sep 05 21:02:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-4c2f94a4-54e7-4dd8-9a30-4674558f94f3 req-cb6b9f5c-068c-4dba-87df-688bb7c7ba32 tempest-TestServerVolumeAttachmentScenario-245042391 None] Terminate volume connection completed successfully. Sep 05 21:02:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-4c2f94a4-54e7-4dd8-9a30-4674558f94f3 req-cb6b9f5c-068c-4dba-87df-688bb7c7ba32 tempest-TestServerVolumeAttachmentScenario-245042391 None] Deleting attachment 3e4866e9-3272-4527-b228-10310a78f636. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:02:49 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-259792d1-b1c4-49b4-a243-ca9fa62a5f08 req-858a1d7a-679d-4b4f-91dc-b5b341973cb5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Terminate volume connection completed successfully. Sep 05 21:02:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-259792d1-b1c4-49b4-a243-ca9fa62a5f08 req-858a1d7a-679d-4b4f-91dc-b5b341973cb5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Deleting attachment c3dda359-377c-4217-bbda-0fe600704462. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:02:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "cinder-cb923359-9709-4ce9-911a-b51e257eafd8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-cb923359-9709-4ce9-911a-b51e257eafd8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "cinder-quobyte-cb923359-9709-4ce9-911a-b51e257eafd8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-quobyte-cb923359-9709-4ce9-911a-b51e257eafd8" acquired by "delete_volume" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7fa0b8-0fce-41da-bc32-a02a077e1bac]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:55 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 Sep 05 21:02:55 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:56 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8" returned: 0 in 0.429s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:56 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8 Sep 05 21:02:56 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:56 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cb923359-9709-4ce9-911a-b51e257eafd8" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-quobyte-cb923359-9709-4ce9-911a-b51e257eafd8" released by "delete_volume" :: held 0.771s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Created reservations ['62906171-c5cc-4043-ae08-4a3243f914d4', '384cba52-cc8d-414a-b255-8a10d0cf0762', 'e21c0d03-35f2-4bd9-9a4e-9407244737de', 'd3306c75-ca9e-4906-836a-52976e24e729'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:56 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:56 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "cinder-fb2361a5-7615-45ac-9d4e-0b4b23dae504-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-fb2361a5-7615-45ac-9d4e-0b4b23dae504-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "cinder-quobyte-fb2361a5-7615-45ac-9d4e-0b4b23dae504" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-quobyte-fb2361a5-7615-45ac-9d4e-0b4b23dae504" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba288a6e-eecb-4cae-8548-1e9b881b60d2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:02:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:57 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.432s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Deleted volume successfully. Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6ba7f3a4-badc-483c-acfc-4c9172fb5069 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-cb923359-9709-4ce9-911a-b51e257eafd8-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:57 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 Sep 05 21:02:57 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:57 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504" returned: 0 in 0.477s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:57 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504 Sep 05 21:02:57 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:57 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fb2361a5-7615-45ac-9d4e-0b4b23dae504" returned: 0 in 0.297s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-quobyte-fb2361a5-7615-45ac-9d4e-0b4b23dae504" released by "delete_volume" :: held 0.842s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Created reservations ['c7139459-659d-47ec-96f2-f984459f7a1a', '48b31438-ce7a-4ae5-8a36-97d71708f27c', '61b33ad1-4c0c-4984-a655-480c0c242ae7', '77035823-b8c8-4a45-9472-21e6d8cbccec'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:02:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:02:57 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:02:57 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:02:58 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 05 21:02:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:02:58 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:02:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Deleted volume successfully. Sep 05 21:02:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4ec243be-59d7-4816-bc5d-1a101e79bcf5 tempest-TestServerVolumeAttachmentScenario-245042391 None] Lock "cinder-fb2361a5-7615-45ac-9d4e-0b4b23dae504-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:03:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:03:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:03:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:03:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:04 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:03:04 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:05 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.374s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:03:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:03:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:03:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:03:07 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=38,cinder:UPDATE=34,cinder:INSERT=11 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:08 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=36,cinder:UPDATE=41,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Flow 'volume_create_manager' (6d5af8bb-e552-43be-8503-964547f82c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e25868-3220-48c0-aa51-8d44203d8d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e25868-3220-48c0-aa51-8d44203d8d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-457251221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a8424e-7c13-450e-a113-3d502777a4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae65db0079545f4be1bb44b32422304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:10Z,use_quota=True,user_id='b707c5052100483f815cc137c82e17fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6494658-f2be-4f5c-a21c-7f737f381ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6494658-f2be-4f5c-a21c-7f737f381ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5e6a08-881a-454e-a556-b6732a6fb4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5e6a08-881a-454e-a556-b6732a6fb4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a8424e-7c13-450e-a113-3d502777a4fc', 'volume_name': 'volume-d0a8424e-7c13-450e-a113-3d502777a4fc', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92cc493-54c6-4623-b483-cb63e65ce73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92cc493-54c6-4623-b483-cb63e65ce73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b0dc90-844e-42fe-9ecc-265a8aa91d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:10 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Volume d0a8424e-7c13-450e-a113-3d502777a4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a8424e-7c13-450e-a113-3d502777a4fc', 'volume_size': 1} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-457251221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a8424e-7c13-450e-a113-3d502777a4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae65db0079545f4be1bb44b32422304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:10Z,use_quota=True,user_id='b707c5052100483f815cc137c82e17fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Creating volume d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:03:10 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:03:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:10 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc 1073741824 Sep 05 21:03:10 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:11 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc 1073741824" returned: 0 in 0.628s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:11 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc Sep 05 21:03:11 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:11 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b0dc90-844e-42fe-9ecc-265a8aa91d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a8424e-7c13-450e-a113-3d502777a4fc', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf5b0e7-ae12-4650-98a8-a4388f68b49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Volume volume-d0a8424e-7c13-450e-a113-3d502777a4fc (d0a8424e-7c13-450e-a113-3d502777a4fc): created successfully Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf5b0e7-ae12-4650-98a8-a4388f68b49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Flow 'volume_create_manager' (6d5af8bb-e552-43be-8503-964547f82c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7893016d-d089-4388-b7ff-4e4337762d87 tempest-TestStampPattern-1382516339 None] Created volume successfully. Sep 05 21:03:21 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:21 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=1 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:03:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-2487a9c9-618a-404a-8e12-dd10bff32c86 req-23749958-c047-4e7e-9375-35a7daf74efe tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-2487a9c9-618a-404a-8e12-dd10bff32c86 req-23749958-c047-4e7e-9375-35a7daf74efe tempest-TestStampPattern-1382516339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-2487a9c9-618a-404a-8e12-dd10bff32c86 req-23749958-c047-4e7e-9375-35a7daf74efe tempest-TestStampPattern-1382516339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-2487a9c9-618a-404a-8e12-dd10bff32c86 req-23749958-c047-4e7e-9375-35a7daf74efe tempest-TestStampPattern-1382516339 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-d0a8424e-7c13-450e-a113-3d502777a4fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '537bafed-1945-4052-81ae-e6ac5b62a415', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:03:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-2487a9c9-618a-404a-8e12-dd10bff32c86 req-23749958-c047-4e7e-9375-35a7daf74efe tempest-TestStampPattern-1382516339 None] attachment_update completed successfully. Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Flow 'volume_create_manager' (84b69c29-2c5e-4e92-a108-48aab1edeb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194a0965-9679-4d0e-b5d0-32f253363f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194a0965-9679-4d0e-b5d0-32f253363f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1592439634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d80265-241f-45b1-b19e-301ce1fd26f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267cd8804ba410d8f9e70420ed3305b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:52Z,use_quota=True,user_id='322282d32d47466f93e47cf2af6802a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7da09b-3caf-4133-b781-f20a3f219033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7da09b-3caf-4133-b781-f20a3f219033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6865dce-df86-438c-866b-5e9a45b19a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6865dce-df86-438c-866b-5e9a45b19a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92d80265-241f-45b1-b19e-301ce1fd26f2', 'volume_name': 'volume-92d80265-241f-45b1-b19e-301ce1fd26f2', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8e42ad-0762-48eb-a0f1-454b0c298d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8e42ad-0762-48eb-a0f1-454b0c298d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d13ff3-acff-49d6-8821-19b4890a6e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:03:52 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Volume 92d80265-241f-45b1-b19e-301ce1fd26f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92d80265-241f-45b1-b19e-301ce1fd26f2', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 21:03:52 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Trying to clone 92d80265-241f-45b1-b19e-301ce1fd26f2 from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:03:53 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:03:53 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Image download 20.69 MB at 20.69 MB/s Sep 05 21:03:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[953971a2-73bc-4cad-9cad-1b2842c9c3f7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:53 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD Sep 05 21:03:53 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:53 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:53 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 is fetched for user 322282d32d47466f93e47cf2af6802a6. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:03:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[149ad135-9c42-49a9-89ba-9fa7f244b882]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:53 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD Sep 05 21:03:53 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:54 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1592439634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d80265-241f-45b1-b19e-301ce1fd26f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267cd8804ba410d8f9e70420ed3305b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:03:52Z,use_quota=True,user_id='322282d32d47466f93e47cf2af6802a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Creating volume 92d80265-241f-45b1-b19e-301ce1fd26f2 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:03:54 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:54 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 1073741824 Sep 05 21:03:54 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:54 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 1073741824" returned: 0 in 0.561s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:54 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 Sep 05 21:03:54 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-5201f6df-2de0-494c-bfb2-59a96fcfd7fd req-e0d072d5-fc08-4836-aee3-2d9a5b600749 tempest-TestStampPattern-1382516339 None] Terminate volume connection completed successfully. Sep 05 21:03:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-5201f6df-2de0-494c-bfb2-59a96fcfd7fd req-e0d072d5-fc08-4836-aee3-2d9a5b600749 tempest-TestStampPattern-1382516339 None] Deleting attachment 537bafed-1945-4052-81ae-e6ac5b62a415. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:03:55 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2" returned: 0 in 0.365s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Attempting download of 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 92d80265-241f-45b1-b19e-301ce1fd26f2. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa1a398-2439-427b-8dbc-ae6123be68e1]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_yoakgc9w {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:55 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_yoakgc9w Sep 05 21:03:55 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:03:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Creating offline snapshot 034c5f3b-52f9-4574-9f75-34321e59be98 of volume d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a6d891-b911-40cd-b8b7-825077898dfa]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:56 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_yoakgc9w" returned: 0 in 0.562s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_yoakgc9w {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:56 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc Sep 05 21:03:56 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:56 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_yoakgc9w Sep 05 21:03:56 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:56 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc" returned: 0 in 0.619s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:56 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 1G Sep 05 21:03:56 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:56 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_yoakgc9w" returned: 1 in 0.583s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_yoakgc9w' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[877da6ee-f5ff-40af-b3cb-da87e9f89e60]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:03:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:56 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD Sep 05 21:03:56 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:57 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] 1e185b14-4f13-44ff-ab1c-d13d5db83085 was qcow2, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:57 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 1G" returned: 0 in 0.487s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a8424e-7c13-450e-a113-3d502777a4fc -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:57 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 Sep 05 21:03:57 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:57 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a8424e-7c13-450e-a113-3d502777a4fc -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 Sep 05 21:03:57 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:57 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0a8424e-7c13-450e-a113-3d502777a4fc -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98" returned: 0 in 0.335s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:57 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 is being set with open permissions: ugo+rw Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:57 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 Sep 05 21:03:57 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:57 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98" returned: 0 in 0.261s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:57 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.info Sep 05 21:03:57 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:58 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.info" returned: 0 in 0.332s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:58 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.info is being set with open permissions: ugo+rw Sep 05 21:03:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:58 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.info Sep 05 21:03:58 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:58 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.info" returned: 0 in 0.318s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.500s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:03:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-28b0a343-0c1d-41b9-bf3a-5bebb35461e1 tempest-TestStampPattern-1382516339 None] Create snapshot completed successfully Sep 05 21:03:59 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2" returned: 0 in 2.236s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_yt6kvkeedevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:03:59 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Converted 112.00 MB image at 50.05 MB/s Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:03:59 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 1G Sep 05 21:03:59 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:03:59 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 1G" returned: 0 in 0.405s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Downloaded image 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 92d80265-241f-45b1-b19e-301ce1fd26f2 successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 for user 322282d32d47466f93e47cf2af6802a6 is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Marking volume 92d80265-241f-45b1-b19e-301ce1fd26f2 as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Copying metadata from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 to 92d80265-241f-45b1-b19e-301ce1fd26f2. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Creating volume glance metadata for volume 92d80265-241f-45b1-b19e-301ce1fd26f2 backed by image 1e185b14-4f13-44ff-ab1c-d13d5db83085 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d13ff3-acff-49d6-8821-19b4890a6e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d80265-241f-45b1-b19e-301ce1fd26f2', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:03:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b91897c-4f9b-4fa4-b2ad-36dbe83b8921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:00 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Volume volume-92d80265-241f-45b1-b19e-301ce1fd26f2 (92d80265-241f-45b1-b19e-301ce1fd26f2): created successfully Sep 05 21:04:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b91897c-4f9b-4fa4-b2ad-36dbe83b8921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Flow 'volume_create_manager' (84b69c29-2c5e-4e92-a108-48aab1edeb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:00 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4105e26a-d0ee-4e9e-8fff-eb45279e4a2e tempest-TestShelveInstance-1463649249 None] Created volume successfully. Sep 05 21:04:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:04:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:05 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:04:05 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-411ad18c-19fd-4ddb-b78b-500797719d8f req-6e73d412-275d-496f-a386-beeb20425b48 tempest-TestShelveInstance-1463649249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-411ad18c-19fd-4ddb-b78b-500797719d8f req-6e73d412-275d-496f-a386-beeb20425b48 tempest-TestShelveInstance-1463649249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-411ad18c-19fd-4ddb-b78b-500797719d8f req-6e73d412-275d-496f-a386-beeb20425b48 tempest-TestShelveInstance-1463649249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-411ad18c-19fd-4ddb-b78b-500797719d8f req-6e73d412-275d-496f-a386-beeb20425b48 tempest-TestShelveInstance-1463649249 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-92d80265-241f-45b1-b19e-301ce1fd26f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '858b2732-1372-468b-b53a-409296252671', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:04:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-411ad18c-19fd-4ddb-b78b-500797719d8f req-6e73d412-275d-496f-a386-beeb20425b48 tempest-TestShelveInstance-1463649249 None] attachment_update completed successfully. Sep 05 21:04:05 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.663s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:04:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (d3523fd5-84ea-46c7-a406-31f0b95ef029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03619cab-1318-4440-b938-07ec7a353f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03619cab-1318-4440-b938-07ec7a353f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563984915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a14424a-254c-4898-9020-e27a7f70c040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:09Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c428661a-13d0-4f06-9104-05e25f108d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c428661a-13d0-4f06-9104-05e25f108d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77403165-607b-4e2b-8223-ba874c1d8a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77403165-607b-4e2b-8223-ba874c1d8a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a14424a-254c-4898-9020-e27a7f70c040', 'volume_name': 'volume-9a14424a-254c-4898-9020-e27a7f70c040', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41435c1-569b-4f94-a8f4-a4d4900e8186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41435c1-569b-4f94-a8f4-a4d4900e8186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4b23da-31dc-4f02-a76e-bb871d3ca4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:08 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Volume 9a14424a-254c-4898-9020-e27a7f70c040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a14424a-254c-4898-9020-e27a7f70c040', 'volume_size': 1} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563984915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a14424a-254c-4898-9020-e27a7f70c040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:09Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Creating volume 9a14424a-254c-4898-9020-e27a7f70c040 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:04:08 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:04:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:08 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 1073741824 Sep 05 21:04:08 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:09 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 1073741824" returned: 0 in 0.686s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:09 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 Sep 05 21:04:09 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:10 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040" returned: 0 in 0.676s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4b23da-31dc-4f02-a76e-bb871d3ca4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a14424a-254c-4898-9020-e27a7f70c040', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8571ef0-48db-46fe-968d-7f30ee1f0ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:10 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Volume volume-9a14424a-254c-4898-9020-e27a7f70c040 (9a14424a-254c-4898-9020-e27a7f70c040): created successfully Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8571ef0-48db-46fe-968d-7f30ee1f0ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (d3523fd5-84ea-46c7-a406-31f0b95ef029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:10 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6df87200-4f18-419e-a5cc-961303f296d0 tempest-VolumesActionsTest-213205972 None] Created volume successfully. Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Flow 'volume_create_manager' (9d491abd-1906-4e82-8aa2-d9ce899d54be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7da10d8-25e6-45ab-85ba-df8137dd64a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7da10d8-25e6-45ab-85ba-df8137dd64a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-452878518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f048271-488f-499b-875f-20cf7ab7ee75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae65db0079545f4be1bb44b32422304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=034c5f3b-52f9-4574-9f75-34321e59be98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:10Z,use_quota=True,user_id='b707c5052100483f815cc137c82e17fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe9109f-0eeb-4fc9-af37-62ad6cae8b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe9109f-0eeb-4fc9-af37-62ad6cae8b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccaae73-91c9-40c3-9227-e630889920e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccaae73-91c9-40c3-9227-e630889920e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f048271-488f-499b-875f-20cf7ab7ee75', 'volume_name': 'volume-5f048271-488f-499b-875f-20cf7ab7ee75', 'volume_size': 1, 'snapshot_id': '034c5f3b-52f9-4574-9f75-34321e59be98'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511dc9ea-fef9-429e-9c6b-dd44999ef89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511dc9ea-fef9-429e-9c6b-dd44999ef89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04df2b7e-2960-4b07-bdcc-86b0fec1a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Volume 5f048271-488f-499b-875f-20cf7ab7ee75: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f048271-488f-499b-875f-20cf7ab7ee75', 'volume_size': 1, 'snapshot_id': '034c5f3b-52f9-4574-9f75-34321e59be98'} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-quobyte-034c5f3b-52f9-4574-9f75-34321e59be98-5f048271-488f-499b-875f-20cf7ab7ee75" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-034c5f3b-52f9-4574-9f75-34321e59be98-5f048271-488f-499b-875f-20cf7ab7ee75" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Creating volume 5f048271-488f-499b-875f-20cf7ab7ee75 from snapshot 034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-quobyte-5f048271-488f-499b-875f-20cf7ab7ee75" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-5f048271-488f-499b-875f-20cf7ab7ee75" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] snapshot: 034c5f3b-52f9-4574-9f75-34321e59be98, volume: 5f048271-488f-499b-875f-20cf7ab7ee75, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2b73779d-204f-4627-a870-bf5a9a774250 tempest-VolumesActionsTest-213205972 None] Acquiring lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040" by "attach_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2b73779d-204f-4627-a870-bf5a9a774250 tempest-VolumesActionsTest-213205972 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040" acquired by "attach_volume" :: waited 0.179s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c327af26-1ea2-4bc4-8238-36f01306852f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2b73779d-204f-4627-a870-bf5a9a774250 tempest-VolumesActionsTest-213205972 None] Attaching volume 9a14424a-254c-4898-9020-e27a7f70c040 to instance 3e2ff128-d653-4f6f-84d1-b85252a698ae at mountpoint /dev/vdb on host None. Sep 05 21:04:12 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 Sep 05 21:04:12 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:12 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2b73779d-204f-4627-a870-bf5a9a774250 tempest-VolumesActionsTest-213205972 None] Attach volume completed successfully. Sep 05 21:04:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2b73779d-204f-4627-a870-bf5a9a774250 tempest-VolumesActionsTest-213205972 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040" released by "attach_volume" :: held 0.323s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:12 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98" returned: 0 in 0.988s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0a8424e-7c13-450e-a113-3d502777a4fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:04:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3bfe77-12ec-4fc0-a087-66a8fc9d83c7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:13 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc Sep 05 21:04:13 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:14 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc" returned: 0 in 1.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:14 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 Sep 05 21:04:14 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c60ff8e3-9b89-427f-aa9c-73611d3a0634 tempest-VolumesActionsTest-738072124 None] Terminate volume connection completed successfully. Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c60ff8e3-9b89-427f-aa9c-73611d3a0634 tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-detach_volume" by "detach_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c60ff8e3-9b89-427f-aa9c-73611d3a0634 tempest-VolumesActionsTest-738072124 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c60ff8e3-9b89-427f-aa9c-73611d3a0634 tempest-VolumesActionsTest-738072124 None] Detaching volume 9a14424a-254c-4898-9020-e27a7f70c040 from instance 3e2ff128-d653-4f6f-84d1-b85252a698ae. Sep 05 21:04:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c60ff8e3-9b89-427f-aa9c-73611d3a0634 tempest-VolumesActionsTest-738072124 None] Detach volume completed successfully. Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c60ff8e3-9b89-427f-aa9c-73611d3a0634 tempest-VolumesActionsTest-738072124 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dc79acd-f249-4e09-9e1a-a3e717870b99 tempest-VolumesActionsTest-213205972 None] Acquiring lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-detach_volume" by "detach_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dc79acd-f249-4e09-9e1a-a3e717870b99 tempest-VolumesActionsTest-213205972 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7dc79acd-f249-4e09-9e1a-a3e717870b99 tempest-VolumesActionsTest-213205972 None] Volume detach called, but volume not attached. Sep 05 21:04:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dc79acd-f249-4e09-9e1a-a3e717870b99 tempest-VolumesActionsTest-213205972 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Acquiring lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Acquiring lock "cinder-quobyte-9a14424a-254c-4898-9020-e27a7f70c040" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Lock "cinder-quobyte-9a14424a-254c-4898-9020-e27a7f70c040" acquired by "delete_volume" :: waited 0.103s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:16 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d8fea-e4cf-4c74-95a7-6f1f4612c47c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:17 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 Sep 05 21:04:17 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:18 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040" returned: 0 in 2.771s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:19 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040 Sep 05 21:04:19 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:20 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9a14424a-254c-4898-9020-e27a7f70c040" returned: 0 in 1.627s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Lock "cinder-quobyte-9a14424a-254c-4898-9020-e27a7f70c040" released by "delete_volume" :: held 4.662s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:20 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Created reservations ['bee6cdd7-c7be-4757-b074-c02fe82f176f', '84d0cb7b-a49b-4396-8306-95ce1ac1765e', '3199a302-0748-44b4-abdf-16c682473ac1', '11af218d-c38d-4409-9508-9983ec6d8741'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:21 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:04:21 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:22 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 1.089s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:22 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Deleted volume successfully. Sep 05 21:04:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e6d2e647-da2e-4d65-b1fb-f4f522b93dd1 tempest-VolumesActionsTest-213205972 None] Lock "cinder-9a14424a-254c-4898-9020-e27a7f70c040-delete_volume" released by "delete_volume" :: held 6.850s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75" returned: 0 in 11.836s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc, size 1024.00 MB, duration 11.84 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:04:26 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Converted 1024.00 MB image at 86.48 MB/s Sep 05 21:04:26 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 is being set with open permissions: ugo+rw Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:26 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 Sep 05 21:04:26 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:26 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75" returned: 0 in 0.554s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-5f048271-488f-499b-875f-20cf7ab7ee75" released by "_copy_volume_from_snapshot" :: held 15.250s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-034c5f3b-52f9-4574-9f75-34321e59be98-5f048271-488f-499b-875f-20cf7ab7ee75" released by "_create_volume_from_snapshot" :: held 15.430s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.475s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04df2b7e-2960-4b07-bdcc-86b0fec1a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f048271-488f-499b-875f-20cf7ab7ee75', 'volume_size': 1, 'snapshot_id': '034c5f3b-52f9-4574-9f75-34321e59be98'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b74cb8-3980-49c5-8f67-42a29158b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:26 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Volume volume-5f048271-488f-499b-875f-20cf7ab7ee75 (5f048271-488f-499b-875f-20cf7ab7ee75): created successfully Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b74cb8-3980-49c5-8f67-42a29158b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Flow 'volume_create_manager' (9d491abd-1906-4e82-8aa2-d9ce899d54be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-592f0a65-bf2e-4123-9949-c9a03bd4bf75 tempest-TestStampPattern-1382516339 None] Created volume successfully. Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (d7132b11-03e6-43eb-8c29-d8006c44c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d27e9e-0270-41fb-a1a5-89dba2841070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d27e9e-0270-41fb-a1a5-89dba2841070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1104728391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf64b844-e22b-4fe4-bb37-17e11c5a7895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:31Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a495bc4-3e81-43a6-9dde-711a5487de7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a495bc4-3e81-43a6-9dde-711a5487de7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59da3cd5-c291-4984-ae72-9b725300dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59da3cd5-c291-4984-ae72-9b725300dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf64b844-e22b-4fe4-bb37-17e11c5a7895', 'volume_name': 'volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432d8051-1c68-4c14-88e4-2af75083db1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432d8051-1c68-4c14-88e4-2af75083db1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65b6dab-389b-4e50-a77f-8a8fd9be07c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:31 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Volume cf64b844-e22b-4fe4-bb37-17e11c5a7895: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895', 'volume_size': 1} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1104728391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf64b844-e22b-4fe4-bb37-17e11c5a7895,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:31Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Creating volume cf64b844-e22b-4fe4-bb37-17e11c5a7895 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:04:31 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:04:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:31 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 1073741824 Sep 05 21:04:31 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:32 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 1073741824" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:32 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 Sep 05 21:04:32 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:32 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895" returned: 0 in 0.423s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65b6dab-389b-4e50-a77f-8a8fd9be07c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95be7f5-f077-415c-bd9f-dfea2af3d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Volume volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 (cf64b844-e22b-4fe4-bb37-17e11c5a7895): created successfully Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95be7f5-f077-415c-bd9f-dfea2af3d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (d7132b11-03e6-43eb-8c29-d8006c44c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-77377078-3a95-4579-9377-1a7720be1d1e tempest-VolumesActionsTest-213205972 None] Created volume successfully. Sep 05 21:04:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-cf64b844-e22b-4fe4-bb37-17e11c5a7895-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Lock "cinder-cf64b844-e22b-4fe4-bb37-17e11c5a7895-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-quobyte-cf64b844-e22b-4fe4-bb37-17e11c5a7895" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-cf64b844-e22b-4fe4-bb37-17e11c5a7895" acquired by "delete_volume" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[05535edb-73db-435d-add7-53f9d6e3f1e0]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:34 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 Sep 05 21:04:34 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:34 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895" returned: 0 in 0.445s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:34 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895 Sep 05 21:04:34 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:34 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cf64b844-e22b-4fe4-bb37-17e11c5a7895" returned: 0 in 0.298s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-cf64b844-e22b-4fe4-bb37-17e11c5a7895" released by "delete_volume" :: held 0.811s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Created reservations ['d88a922b-fe06-4960-a4be-68b4760292bf', '8d7530f5-24f1-4056-adc6-605ccdacb253', 'a37a9caf-ef99-449f-93d5-8a07b87884a8', '93fad38c-de39-4fad-b676-f798e184aa1b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:35 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:04:35 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:35 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.457s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:35 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:35 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Deleted volume successfully. Sep 05 21:04:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4bf9b1b5-a110-46c7-87fb-62a40c0fc9e8 tempest-VolumesActionsTest-738072124 None] Lock "cinder-cf64b844-e22b-4fe4-bb37-17e11c5a7895-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:35 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (e04b89a4-f5cb-4fae-b02b-430c8a3e6455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9786760-a661-4168-9887-849d2a97ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9786760-a661-4168-9887-849d2a97ff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173675587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0777c9-f209-4265-b815-ba75021a13d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:36Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d49fd1-d790-4420-a7df-4e9adaaf9d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d49fd1-d790-4420-a7df-4e9adaaf9d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0723a6b8-d25e-4fb0-8564-eb23625713ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0723a6b8-d25e-4fb0-8564-eb23625713ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0777c9-f209-4265-b815-ba75021a13d8', 'volume_name': 'volume-3b0777c9-f209-4265-b815-ba75021a13d8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce40f901-5d45-43f0-82b1-869932cb3ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce40f901-5d45-43f0-82b1-869932cb3ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6abfd3-1c5f-4095-9dea-2f8b063a3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:36 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Volume 3b0777c9-f209-4265-b815-ba75021a13d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0777c9-f209-4265-b815-ba75021a13d8', 'volume_size': 1} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-173675587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0777c9-f209-4265-b815-ba75021a13d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:36Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Creating volume 3b0777c9-f209-4265-b815-ba75021a13d8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:04:36 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:36 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 1073741824 Sep 05 21:04:36 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:36 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 1073741824" returned: 0 in 0.736s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:36 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 Sep 05 21:04:36 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:37 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8" returned: 0 in 0.443s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6abfd3-1c5f-4095-9dea-2f8b063a3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0777c9-f209-4265-b815-ba75021a13d8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624e2e7-166a-4335-aa3f-94617c0416b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:37 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Volume volume-3b0777c9-f209-4265-b815-ba75021a13d8 (3b0777c9-f209-4265-b815-ba75021a13d8): created successfully Sep 05 21:04:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c624e2e7-166a-4335-aa3f-94617c0416b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (e04b89a4-f5cb-4fae-b02b-430c8a3e6455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:37 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-dfbfb720-8886-4c7e-ba1f-62897e6d478c tempest-VolumesActionsTest-213205972 None] Created volume successfully. Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-3b0777c9-f209-4265-b815-ba75021a13d8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Lock "cinder-3b0777c9-f209-4265-b815-ba75021a13d8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-quobyte-3b0777c9-f209-4265-b815-ba75021a13d8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-3b0777c9-f209-4265-b815-ba75021a13d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfeed2-19d3-4aa6-844a-dfe0fb19cf91]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:38 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 Sep 05 21:04:38 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:38 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8" returned: 0 in 0.391s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:38 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8 Sep 05 21:04:38 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:38 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3b0777c9-f209-4265-b815-ba75021a13d8" returned: 0 in 0.284s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-3b0777c9-f209-4265-b815-ba75021a13d8" released by "delete_volume" :: held 0.718s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Created reservations ['cf5c703f-b6f5-4f4a-94f1-31b40697cd1c', 'be3254a7-4576-4201-b98f-c0bdaf917867', 'f62d2ed9-4d7b-488a-b054-072c9609490f', 'f4a82c35-35a5-45f3-a93c-fae2c9f90b47'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:39 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:04:39 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:39 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.335s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:39 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Deleted volume successfully. Sep 05 21:04:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e691eaf-eb97-463d-9d8f-b0bd23fd4ddf tempest-VolumesActionsTest-738072124 None] Lock "cinder-3b0777c9-f209-4265-b815-ba75021a13d8-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (0488c6d2-e624-44bc-8cd5-671407153d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a71135-8362-4192-ab87-3d0e6c36e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a71135-8362-4192-ab87-3d0e6c36e343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398373035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a727c48-5cda-4b18-b4e0-b1c3ce2af06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:40Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8747e37d-6f0b-4882-b581-11c3671d86d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8747e37d-6f0b-4882-b581-11c3671d86d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d8350d-cddc-4ad9-8d13-d060ad62cf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d8350d-cddc-4ad9-8d13-d060ad62cf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a727c48-5cda-4b18-b4e0-b1c3ce2af06e', 'volume_name': 'volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa81cc1c-709c-48a9-a547-d49fb8852598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa81cc1c-709c-48a9-a547-d49fb8852598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b846d3f3-912b-4173-b59e-9c2142b97f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Volume 0a727c48-5cda-4b18-b4e0-b1c3ce2af06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e', 'volume_size': 1} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398373035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a727c48-5cda-4b18-b4e0-b1c3ce2af06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:40Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Creating volume 0a727c48-5cda-4b18-b4e0-b1c3ce2af06e {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:04:40 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:40 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e 1073741824 Sep 05 21:04:40 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:40 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e 1073741824" returned: 0 in 0.487s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:40 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e Sep 05 21:04:40 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:40 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e" returned: 0 in 0.251s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b846d3f3-912b-4173-b59e-9c2142b97f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1808d8b3-e941-4bfb-9637-eb7ed27cccd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Volume volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e (0a727c48-5cda-4b18-b4e0-b1c3ce2af06e): created successfully Sep 05 21:04:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1808d8b3-e941-4bfb-9637-eb7ed27cccd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (0488c6d2-e624-44bc-8cd5-671407153d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:41 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a2536781-4753-441f-8e1c-822c6b6c6a25 tempest-VolumesActionsTest-213205972 None] Created volume successfully. Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Lock "cinder-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-quobyte-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b8cd4-958c-40e0-8976-8281156a1eb2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:42 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e Sep 05 21:04:42 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:42 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e" returned: 0 in 0.488s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:42 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e Sep 05 21:04:42 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:43 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e" returned: 0 in 0.318s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e" released by "delete_volume" :: held 0.857s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Created reservations ['1294270d-9822-49aa-adbc-982526a2b8b0', '01e87675-0ed4-4e10-9e8f-3a1e2f695267', 'cd6c24e6-4b5d-477a-ad75-a9c930bbf2f2', '187d5004-360c-4539-94a0-224241c8ad92'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:43 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:04:43 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:43 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.276s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Deleted volume successfully. Sep 05 21:04:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-61862d70-72e9-4676-b01e-1eb988cf9df0 tempest-VolumesActionsTest-738072124 None] Lock "cinder-0a727c48-5cda-4b18-b4e0-b1c3ce2af06e-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (f01f09d5-c8a8-4d50-8b62-35b0eb6572d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15932293-b9af-4076-a5f2-49c3138ba37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15932293-b9af-4076-a5f2-49c3138ba37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1596571757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4f7719-100c-43b9-a43a-92a178f9cd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:44Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f6b393-3bf3-41f7-bbb7-fad4ac06f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f6b393-3bf3-41f7-bbb7-fad4ac06f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3005ad5-68bb-4688-9a2e-cdd334a6c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3005ad5-68bb-4688-9a2e-cdd334a6c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4f7719-100c-43b9-a43a-92a178f9cd59', 'volume_name': 'volume-1e4f7719-100c-43b9-a43a-92a178f9cd59', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9176b3b-8519-4bdb-b9a0-f792f866834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9176b3b-8519-4bdb-b9a0-f792f866834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c76337-c1e6-4104-89bf-33193740e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:44 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Volume 1e4f7719-100c-43b9-a43a-92a178f9cd59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4f7719-100c-43b9-a43a-92a178f9cd59', 'volume_size': 1} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1596571757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4f7719-100c-43b9-a43a-92a178f9cd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:44Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Creating volume 1e4f7719-100c-43b9-a43a-92a178f9cd59 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:04:44 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:44 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 1073741824 Sep 05 21:04:44 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:44 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 1073741824" returned: 0 in 0.509s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:44 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 Sep 05 21:04:44 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:45 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c76337-c1e6-4104-89bf-33193740e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4f7719-100c-43b9-a43a-92a178f9cd59', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07437b15-bbb7-4ea5-9455-39b89c43d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:45 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Volume volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 (1e4f7719-100c-43b9-a43a-92a178f9cd59): created successfully Sep 05 21:04:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07437b15-bbb7-4ea5-9455-39b89c43d996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (f01f09d5-c8a8-4d50-8b62-35b0eb6572d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ea22b940-b410-4c7b-9e53-778eff1d38ef tempest-VolumesActionsTest-213205972 None] Created volume successfully. Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-1e4f7719-100c-43b9-a43a-92a178f9cd59-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Lock "cinder-1e4f7719-100c-43b9-a43a-92a178f9cd59-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Acquiring lock "cinder-quobyte-1e4f7719-100c-43b9-a43a-92a178f9cd59" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-1e4f7719-100c-43b9-a43a-92a178f9cd59" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[543b4ea1-0635-4ea3-b866-8f340de7525d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:46 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 Sep 05 21:04:46 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:46 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59" returned: 0 in 0.377s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:46 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59 Sep 05 21:04:46 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:47 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4f7719-100c-43b9-a43a-92a178f9cd59" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Lock "cinder-quobyte-1e4f7719-100c-43b9-a43a-92a178f9cd59" released by "delete_volume" :: held 0.675s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=66,cinder:UPDATE=63,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=74,cinder:UPDATE=63,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Created reservations ['dedc07f7-34dc-4871-bd1f-713a8d0fa137', '07d21cb9-898d-4df9-bc53-f35eceee7a08', 'c7792d03-6a9d-4b9e-84ed-fc9da3f3998d', '3de959eb-7f93-4e85-b69b-5fcd135c73af'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:47 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:04:47 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:47 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Deleted volume successfully. Sep 05 21:04:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5c5ed5d3-85fb-4430-8368-0621f3a15dd1 tempest-VolumesActionsTest-738072124 None] Lock "cinder-1e4f7719-100c-43b9-a43a-92a178f9cd59-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (78f01103-8bcf-46f5-9b41-acd349288e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176926f9-1ee3-42c6-9893-97afef08f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176926f9-1ee3-42c6-9893-97afef08f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839026138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a6dd4f-baa4-4d1a-ae44-3849853b0c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:48Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4820361-6695-4f01-b234-dd6df7db6ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4820361-6695-4f01-b234-dd6df7db6ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2d39ef-4654-4267-9fa1-8e3b0a9fa1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2d39ef-4654-4267-9fa1-8e3b0a9fa1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a6dd4f-baa4-4d1a-ae44-3849853b0c99', 'volume_name': 'volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8a28a4-262b-4e5c-be04-ed366b0a93d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8a28a4-262b-4e5c-be04-ed366b0a93d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca426cc-44dc-464d-bc5c-f3f009e2867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:48 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Volume e2a6dd4f-baa4-4d1a-ae44-3849853b0c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99', 'volume_size': 1} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-839026138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a6dd4f-baa4-4d1a-ae44-3849853b0c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc00b01279ec4729bb9867abd72f6276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:04:48Z,use_quota=True,user_id='2131f09839ba4e6eb5602b0eb741b43b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Creating volume e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:04:48 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:48 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 1073741824 Sep 05 21:04:48 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:48 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 1073741824" returned: 0 in 0.474s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:48 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 Sep 05 21:04:48 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:49 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99" returned: 0 in 0.261s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:04:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca426cc-44dc-464d-bc5c-f3f009e2867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b47520-410c-40be-aadb-2123b4593f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:04:49 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Volume volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 (e2a6dd4f-baa4-4d1a-ae44-3849853b0c99): created successfully Sep 05 21:04:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b47520-410c-40be-aadb-2123b4593f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:04:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Flow 'volume_create_manager' (78f01103-8bcf-46f5-9b41-acd349288e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:04:49 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6071157d-42d4-4406-956c-436c1e8496b8 tempest-VolumesActionsTest-213205972 None] Created volume successfully. Sep 05 21:04:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-8969e5c8-af48-4ed1-9106-7f31c8701591 req-8bc58b9a-b12c-4075-9cf4-215a43b4bfd2 tempest-TestShelveInstance-1463649249 None] Terminate volume connection completed successfully. Sep 05 21:04:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-8969e5c8-af48-4ed1-9106-7f31c8701591 req-8bc58b9a-b12c-4075-9cf4-215a43b4bfd2 tempest-TestShelveInstance-1463649249 None] Deleting attachment 858b2732-1372-468b-b53a-409296252671. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:04:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Acquiring lock "cinder-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Lock "cinder-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Acquiring lock "cinder-quobyte-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Lock "cinder-quobyte-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3889cf7-95de-425b-b2c6-2e445c34e3d2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:51 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 Sep 05 21:04:51 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:51 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99" returned: 0 in 0.432s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:51 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99 Sep 05 21:04:51 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:51 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99" returned: 0 in 0.279s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Lock "cinder-quobyte-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99" released by "delete_volume" :: held 0.763s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Created reservations ['073bb318-900e-4db2-b004-f1744bfa32d5', '3fdace5e-b379-400f-b3a5-f662f340db5c', '456617e8-1223-4ecd-94ca-adcd8ef8610d', '79bcfd75-e6eb-4022-8d8d-236d2a1ed110'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:04:51 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:04:51 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:04:52 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 05 21:04:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.281s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:04:52 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:04:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Deleted volume successfully. Sep 05 21:04:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b94089-9963-4cbc-a9b2-013ba8863432 tempest-VolumesActionsTest-213205972 None] Lock "cinder-e2a6dd4f-baa4-4d1a-ae44-3849853b0c99-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:04:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-c4de3261-6997-42f8-8294-a715211789d3 req-3d6271f0-3eed-46a2-9671-79f4c2db210e tempest-TestShelveInstance-1463649249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:04:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-c4de3261-6997-42f8-8294-a715211789d3 req-3d6271f0-3eed-46a2-9671-79f4c2db210e tempest-TestShelveInstance-1463649249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:04:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-c4de3261-6997-42f8-8294-a715211789d3 req-3d6271f0-3eed-46a2-9671-79f4c2db210e tempest-TestShelveInstance-1463649249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:04:52 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-c4de3261-6997-42f8-8294-a715211789d3 req-3d6271f0-3eed-46a2-9671-79f4c2db210e tempest-TestShelveInstance-1463649249 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-92d80265-241f-45b1-b19e-301ce1fd26f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3379874e-e48c-415c-aab7-13fafa3c7a70', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:04:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-c4de3261-6997-42f8-8294-a715211789d3 req-3d6271f0-3eed-46a2-9671-79f4c2db210e tempest-TestShelveInstance-1463649249 None] attachment_update completed successfully. Sep 05 21:05:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-8beefb8f-3d60-41ea-a9ea-1833ad458744 req-20c8f626-f689-4b69-bcb4-3ac3d875110f tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-8beefb8f-3d60-41ea-a9ea-1833ad458744 req-20c8f626-f689-4b69-bcb4-3ac3d875110f tempest-TestStampPattern-1382516339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-8beefb8f-3d60-41ea-a9ea-1833ad458744 req-20c8f626-f689-4b69-bcb4-3ac3d875110f tempest-TestStampPattern-1382516339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-8beefb8f-3d60-41ea-a9ea-1833ad458744 req-20c8f626-f689-4b69-bcb4-3ac3d875110f tempest-TestStampPattern-1382516339 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361', 'name': 'volume-5f048271-488f-499b-875f-20cf7ab7ee75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a29b967c-01aa-4827-b606-7ed97a5af399', 'enforce_multipath': True} {{(pid=87778) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 05 21:05:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-8beefb8f-3d60-41ea-a9ea-1833ad458744 req-20c8f626-f689-4b69-bcb4-3ac3d875110f tempest-TestStampPattern-1382516339 None] attachment_update completed successfully. Sep 05 21:05:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-9719ec33-791a-49b3-9111-0d82352c5fc3 req-1da28446-6ef2-4b6c-8ad3-10753d26898c tempest-TestStampPattern-1382516339 None] Terminate volume connection completed successfully. Sep 05 21:05:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-9719ec33-791a-49b3-9111-0d82352c5fc3 req-1da28446-6ef2-4b6c-8ad3-10753d26898c tempest-TestStampPattern-1382516339 None] Deleting attachment a29b967c-01aa-4827-b606-7ed97a5af399. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:05:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:05:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:04 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:04 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:05 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.589s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:05:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:05:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Flow 'volume_create_manager' (e8c15ce1-aa0f-4d18-a5fd-c90a6f9457a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04357476-b925-4419-bd43-93f7bb25e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04357476-b925-4419-bd43-93f7bb25e178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-39246843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54895a4e-8bdb-4205-8106-e6be82510e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18148e17c44445758aa91b242e38164c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:09Z,use_quota=True,user_id='1de24a560a2640218dd4944b2e3f808e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4088950-12e6-48fc-810c-6f8d7147499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4088950-12e6-48fc-810c-6f8d7147499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fba30ce-a0e0-41fb-92bc-65a1f9ff7feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fba30ce-a0e0-41fb-92bc-65a1f9ff7feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54895a4e-8bdb-4205-8106-e6be82510e71', 'volume_name': 'volume-54895a4e-8bdb-4205-8106-e6be82510e71', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be975dbc-4620-48f4-ba1c-0d662df3646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be975dbc-4620-48f4-ba1c-0d662df3646b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbea89a0-1b82-41fd-9c94-c6b6ac2da94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:09 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Volume 54895a4e-8bdb-4205-8106-e6be82510e71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54895a4e-8bdb-4205-8106-e6be82510e71', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Trying to clone 54895a4e-8bdb-4205-8106-e6be82510e71 from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-5f048271-488f-499b-875f-20cf7ab7ee75-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Lock "cinder-5f048271-488f-499b-875f-20cf7ab7ee75-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-quobyte-5f048271-488f-499b-875f-20cf7ab7ee75" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-5f048271-488f-499b-875f-20cf7ab7ee75" acquired by "delete_volume" :: waited 0.056s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d94e8d-d064-4889-b692-19dc7cc1c316]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:05:10 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Image download 20.69 MB at 20.69 MB/s Sep 05 21:05:10 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 Sep 05 21:05:10 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b927f-c5a4-4b04-819b-9104297c1a73]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD Sep 05 21:05:10 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75" returned: 0 in 0.425s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75 Sep 05 21:05:10 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:10 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 is fetched for user 1de24a560a2640218dd4944b2e3f808e. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa667f-b03d-4502-8b39-dcdd62010902]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:10 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-5f048271-488f-499b-875f-20cf7ab7ee75" returned: 0 in 0.272s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-5f048271-488f-499b-875f-20cf7ab7ee75" released by "delete_volume" :: held 0.776s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:10 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Created reservations ['9ce16f1c-c37d-4f8d-ba9c-d6c06e5694dd', '3bf49b35-bef6-4f88-a795-5250333bcfb9', '3b306cc0-3d10-4519-ab67-fe336a7d7efc', 'f8388eed-8b2a-44c9-acda-06196cb18c4a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:10 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD Sep 05 21:05:10 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:11 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-39246843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54895a4e-8bdb-4205-8106-e6be82510e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18148e17c44445758aa91b242e38164c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:09Z,use_quota=True,user_id='1de24a560a2640218dd4944b2e3f808e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Creating volume 54895a4e-8bdb-4205-8106-e6be82510e71 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:11 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 1073741824 Sep 05 21:05:11 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.328s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Deleted volume successfully. Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dcf0ef47-df85-4bd5-a2fd-ee948a03b4af tempest-TestStampPattern-1382516339 None] Lock "cinder-5f048271-488f-499b-875f-20cf7ab7ee75-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-034c5f3b-52f9-4574-9f75-34321e59be98-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Lock "cinder-034c5f3b-52f9-4574-9f75-34321e59be98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-quobyte-d0a8424e-7c13-450e-a113-3d502777a4fc" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-d0a8424e-7c13-450e-a113-3d502777a4fc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-quobyte-034c5f3b-52f9-4574-9f75-34321e59be98" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-034c5f3b-52f9-4574-9f75-34321e59be98" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Deleting offline snapshot 034c5f3b-52f9-4574-9f75-34321e59be98 of volume d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] snapshot_file for this snap is: volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[111145b0-fa7f-4be4-ba3a-cd69184f6381]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 Sep 05 21:05:11 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:11 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 1073741824" returned: 0 in 0.629s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:11 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 Sep 05 21:05:11 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98" returned: 0 in 0.407s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0a8424e-7c13-450e-a113-3d502777a4fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[812c2713-6602-4cd8-8d13-5d7507710dea]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71" returned: 0 in 0.270s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Attempting download of 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 54895a4e-8bdb-4205-8106-e6be82510e71. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eddaf69-59ee-40c5-95ec-22afe71ba0c9]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_d5vwu80l {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc Sep 05 21:05:12 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_d5vwu80l Sep 05 21:05:12 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_d5vwu80l" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_d5vwu80l {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:12 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_d5vwu80l Sep 05 21:05:12 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc" returned: 0 in 0.615s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:12 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 Sep 05 21:05:12 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_d5vwu80l" returned: 1 in 0.399s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_d5vwu80l' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f79115-42d0-4a81-8bdf-661a8b304a81]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:13 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98" returned: 0 in 0.395s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:13 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD Sep 05 21:05:13 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98 Sep 05 21:05:13 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] 1e185b14-4f13-44ff-ab1c-d13d5db83085 was qcow2, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:13 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc.034c5f3b-52f9-4574-9f75-34321e59be98" returned: 0 in 0.306s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:13 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 Sep 05 21:05:13 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-034c5f3b-52f9-4574-9f75-34321e59be98" released by "_delete_snapshot" :: held 1.839s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-d0a8424e-7c13-450e-a113-3d502777a4fc" released by "delete_snapshot" :: held 1.875s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Created reservations ['68a48030-1d5a-4857-8103-7708c58f7059', '08341b30-89d6-414c-818c-b50f7138905e', '6d7b1a5a-ac72-4747-a69a-f5466a689748', '4927f6ef-621f-4fc5-90bf-518bf935c468'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Delete snapshot completed successfully. Sep 05 21:05:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf41492b-9902-4306-93cb-6ab5b91a8e1b tempest-TestStampPattern-1382516339 None] Lock "cinder-034c5f3b-52f9-4574-9f75-34321e59be98-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:15 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71" returned: 0 in 2.188s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:15 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_2bm7h2qmdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:05:15 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Converted 112.00 MB image at 51.17 MB/s Sep 05 21:05:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:15 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 1G Sep 05 21:05:15 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:16 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 1G" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Downloaded image 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume 54895a4e-8bdb-4205-8106-e6be82510e71 successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 for user 1de24a560a2640218dd4944b2e3f808e is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Marking volume 54895a4e-8bdb-4205-8106-e6be82510e71 as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Copying metadata from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 to 54895a4e-8bdb-4205-8106-e6be82510e71. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Creating volume glance metadata for volume 54895a4e-8bdb-4205-8106-e6be82510e71 backed by image 1e185b14-4f13-44ff-ab1c-d13d5db83085 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbea89a0-1b82-41fd-9c94-c6b6ac2da94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54895a4e-8bdb-4205-8106-e6be82510e71', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b800d1d8-d5d4-4e40-bd95-13fb423ab7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:16 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Volume volume-54895a4e-8bdb-4205-8106-e6be82510e71 (54895a4e-8bdb-4205-8106-e6be82510e71): created successfully Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b800d1d8-d5d4-4e40-bd95-13fb423ab7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Flow 'volume_create_manager' (e8c15ce1-aa0f-4d18-a5fd-c90a6f9457a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-85b942d8-bfd8-4163-84dc-3f4f4fd821e7 tempest-VolumesImageMetadata-177947354 None] Created volume successfully. Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Acquiring lock "cinder-54895a4e-8bdb-4205-8106-e6be82510e71-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Lock "cinder-54895a4e-8bdb-4205-8106-e6be82510e71-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Acquiring lock "cinder-quobyte-54895a4e-8bdb-4205-8106-e6be82510e71" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Lock "cinder-quobyte-54895a4e-8bdb-4205-8106-e6be82510e71" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda043cc-56f3-44e8-80da-a2c8a83a9293]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-d0a8424e-7c13-450e-a113-3d502777a4fc-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Lock "cinder-d0a8424e-7c13-450e-a113-3d502777a4fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:17 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 Sep 05 21:05:17 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Acquiring lock "cinder-quobyte-d0a8424e-7c13-450e-a113-3d502777a4fc" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-d0a8424e-7c13-450e-a113-3d502777a4fc" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7acd066-726c-43ba-a454-37d6d5a111a2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:17 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc Sep 05 21:05:17 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:18 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:18 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71 Sep 05 21:05:18 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:18 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc" returned: 0 in 0.395s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:18 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc Sep 05 21:05:18 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:18 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-54895a4e-8bdb-4205-8106-e6be82510e71" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Lock "cinder-quobyte-54895a4e-8bdb-4205-8106-e6be82510e71" released by "delete_volume" :: held 0.715s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Created reservations ['5c76e08b-d069-4e38-b9c8-bfed0f67fefa', '382fa667-5ebf-4101-8981-4d1ea1118dc9', 'b598a732-786c-4d98-a48c-d690d4de1b80', '9505a4d5-67fd-479e-ad18-431a74284574'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:18 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:18 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:18 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d0a8424e-7c13-450e-a113-3d502777a4fc" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Lock "cinder-quobyte-d0a8424e-7c13-450e-a113-3d502777a4fc" released by "delete_volume" :: held 0.721s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Created reservations ['88425552-e045-4990-bd66-26d77d1ae560', '2d83483f-f1b6-4713-a05a-e25c8253ba35', '12b5ca73-bcd5-4f5a-86af-c4159d3ec113', 'f48ffb32-1055-42a8-9094-87b19d81828f'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:18 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:18 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:18 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.321s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Deleted volume successfully. Sep 05 21:05:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-343f32c3-7071-4a37-977a-e9eafb4bacb9 tempest-VolumesImageMetadata-177947354 None] Lock "cinder-54895a4e-8bdb-4205-8106-e6be82510e71-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:19 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.367s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:19 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:19 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Deleted volume successfully. Sep 05 21:05:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6bb47ee5-b2f9-40ba-a282-168fc01fe550 tempest-TestStampPattern-1382516339 None] Lock "cinder-d0a8424e-7c13-450e-a113-3d502777a4fc-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Flow 'volume_create_manager' (e8712a41-a1a0-49a6-8feb-a5e7e429f2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93db1f67-735a-4470-b718-7871b9732759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93db1f67-735a-4470-b718-7871b9732759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-834950167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57259f12-263e-4f9e-b0ab-b9f8154bb131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43086b2625e430d95c6194e0f0838cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:25Z,use_quota=True,user_id='2605e626a63847f6b1257df1d52625e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e4ebba-a9ae-4d50-a5ec-800fac63535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e4ebba-a9ae-4d50-a5ec-800fac63535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683bd10f-2a6e-4860-abb6-85c4bd85029c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683bd10f-2a6e-4860-abb6-85c4bd85029c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57259f12-263e-4f9e-b0ab-b9f8154bb131', 'volume_name': 'volume-57259f12-263e-4f9e-b0ab-b9f8154bb131', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13e8232-8faf-4cc0-aac3-171c8e47d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e13e8232-8faf-4cc0-aac3-171c8e47d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04f0c63-68f8-409e-a773-c7836a3c7aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:24 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Volume 57259f12-263e-4f9e-b0ab-b9f8154bb131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57259f12-263e-4f9e-b0ab-b9f8154bb131', 'volume_size': 1} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-834950167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57259f12-263e-4f9e-b0ab-b9f8154bb131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43086b2625e430d95c6194e0f0838cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:25Z,use_quota=True,user_id='2605e626a63847f6b1257df1d52625e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Creating volume 57259f12-263e-4f9e-b0ab-b9f8154bb131 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:24 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:24 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 1073741824 Sep 05 21:05:24 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:25 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 1073741824" returned: 0 in 0.460s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:25 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 Sep 05 21:05:25 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:25 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131" returned: 0 in 0.330s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04f0c63-68f8-409e-a773-c7836a3c7aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57259f12-263e-4f9e-b0ab-b9f8154bb131', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e61a8f9-5e1e-4655-9cae-4fc8449e04c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:25 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Volume volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 (57259f12-263e-4f9e-b0ab-b9f8154bb131): created successfully Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e61a8f9-5e1e-4655-9cae-4fc8449e04c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Flow 'volume_create_manager' (e8712a41-a1a0-49a6-8feb-a5e7e429f2f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8ec0da3e-6b77-483b-ada7-7dffb9e346d9 tempest-VolumesTransfersTest-213787467 None] Created volume successfully. Sep 05 21:05:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f5d63724-7f0c-458e-8391-ec39b09e30ec tempest-VolumesTransfersTest-1416325961 None] Transfer volume completed successfully. Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Acquiring lock "cinder-57259f12-263e-4f9e-b0ab-b9f8154bb131-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Lock "cinder-57259f12-263e-4f9e-b0ab-b9f8154bb131-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Acquiring lock "cinder-quobyte-57259f12-263e-4f9e-b0ab-b9f8154bb131" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Lock "cinder-quobyte-57259f12-263e-4f9e-b0ab-b9f8154bb131" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab96d94-3312-4951-83ef-27bfaaa2b1e9]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:28 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 Sep 05 21:05:28 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:28 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131" returned: 0 in 0.427s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:28 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131 Sep 05 21:05:28 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:29 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57259f12-263e-4f9e-b0ab-b9f8154bb131" returned: 0 in 0.290s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Lock "cinder-quobyte-57259f12-263e-4f9e-b0ab-b9f8154bb131" released by "delete_volume" :: held 0.765s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Created reservations ['80bcbd88-07d6-42d9-8c19-25212e42492f', '74cb89c9-5dc3-4701-a322-c76e83a99d29', '018fc1bd-4c54-4b4f-94c5-f3182325d91d', 'b00e0af5-1384-472f-8c73-c5b8ed8c958f'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:29 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:29 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:29 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.288s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Deleted volume successfully. Sep 05 21:05:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc0845fb-416c-454e-94d2-7be6f6358c4d tempest-VolumesTransfersTest-613638423 None] Lock "cinder-57259f12-263e-4f9e-b0ab-b9f8154bb131-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Flow 'volume_create_manager' (fd3c0da3-2629-4e16-b2c0-c8e5a916dc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9cf93c-9d90-4b0a-87e2-4744f2f9027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9cf93c-9d90-4b0a-87e2-4744f2f9027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1848704056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886e1714-e61d-4d14-ad2e-dcaa9d2e148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43086b2625e430d95c6194e0f0838cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:30Z,use_quota=True,user_id='2605e626a63847f6b1257df1d52625e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5520f-295c-4059-bf05-a782d020f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5520f-295c-4059-bf05-a782d020f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc93055-0159-4e19-be19-765bb6ce1d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc93055-0159-4e19-be19-765bb6ce1d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886e1714-e61d-4d14-ad2e-dcaa9d2e148e', 'volume_name': 'volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc545803-5381-4248-84ee-fb08cab08dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc545803-5381-4248-84ee-fb08cab08dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6032c25-d280-452b-8ec1-69b169e0ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:30 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Volume 886e1714-e61d-4d14-ad2e-dcaa9d2e148e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e', 'volume_size': 1} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1848704056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886e1714-e61d-4d14-ad2e-dcaa9d2e148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43086b2625e430d95c6194e0f0838cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:30Z,use_quota=True,user_id='2605e626a63847f6b1257df1d52625e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Creating volume 886e1714-e61d-4d14-ad2e-dcaa9d2e148e {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:30 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:30 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e 1073741824 Sep 05 21:05:30 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:30 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e 1073741824" returned: 0 in 0.464s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:30 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e Sep 05 21:05:30 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:30 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6032c25-d280-452b-8ec1-69b169e0ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7255a60c-c65d-4387-b6c3-7857db779d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:30 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Volume volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e (886e1714-e61d-4d14-ad2e-dcaa9d2e148e): created successfully Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7255a60c-c65d-4387-b6c3-7857db779d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Flow 'volume_create_manager' (fd3c0da3-2629-4e16-b2c0-c8e5a916dc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ca305259-86f4-44e3-b13c-b4ee2271a739 tempest-VolumesTransfersTest-213787467 None] Created volume successfully. Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Acquiring lock "cinder-886e1714-e61d-4d14-ad2e-dcaa9d2e148e-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Lock "cinder-886e1714-e61d-4d14-ad2e-dcaa9d2e148e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Acquiring lock "cinder-quobyte-886e1714-e61d-4d14-ad2e-dcaa9d2e148e" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Lock "cinder-quobyte-886e1714-e61d-4d14-ad2e-dcaa9d2e148e" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cd0e88-1ff5-468b-b3ac-060061a74f0a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:32 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e Sep 05 21:05:32 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:32 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e" returned: 0 in 0.386s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:32 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e Sep 05 21:05:32 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (f33f78e1-e9df-4284-9b19-a72d37db1d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dcafd1-8de9-4ac7-baaa-7b98551a6430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dcafd1-8de9-4ac7-baaa-7b98551a6430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-251975067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89286ee8-cf33-46e3-a85b-5e879ad7fc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:33Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:33 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10679f3-69bf-499a-b021-0de6dfa2d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10679f3-69bf-499a-b021-0de6dfa2d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40716d3b-0122-4614-ac31-317cba97e985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40716d3b-0122-4614-ac31-317cba97e985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89286ee8-cf33-46e3-a85b-5e879ad7fc17', 'volume_name': 'volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaabd4d-6e6d-4f64-b2cd-16f41cc26ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaabd4d-6e6d-4f64-b2cd-16f41cc26ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f0d291-0af8-4dd1-9034-232ea9871515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume 89286ee8-cf33-46e3-a85b-5e879ad7fc17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17', 'volume_size': 1} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-251975067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89286ee8-cf33-46e3-a85b-5e879ad7fc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:33Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Creating volume 89286ee8-cf33-46e3-a85b-5e879ad7fc17 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:33 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-886e1714-e61d-4d14-ad2e-dcaa9d2e148e" returned: 0 in 0.330s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:33 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 1073741824 Sep 05 21:05:33 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Lock "cinder-quobyte-886e1714-e61d-4d14-ad2e-dcaa9d2e148e" released by "delete_volume" :: held 0.762s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Created reservations ['c3bc837e-0b8f-41db-b44c-79c8be7e5f0c', 'bc60a39d-dc26-4903-baf7-a222be199347', '2f580b78-87d0-49af-a398-4d8ab5737c57', '73808f2f-2ed5-4400-ba58-5f04328a68b1'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:33 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:33 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:33 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:33 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Deleted volume successfully. Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-46482221-e900-4610-a595-4d38e9b86391 tempest-VolumesTransfersTest-613638423 None] Lock "cinder-886e1714-e61d-4d14-ad2e-dcaa9d2e148e-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:33 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 1073741824" returned: 0 in 0.503s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:33 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 Sep 05 21:05:33 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:34 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17" returned: 0 in 0.273s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f0d291-0af8-4dd1-9034-232ea9871515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f0a459-477a-4d28-ba47-83a27f680a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 (89286ee8-cf33-46e3-a85b-5e879ad7fc17): created successfully Sep 05 21:05:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f0a459-477a-4d28-ba47-83a27f680a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (f33f78e1-e9df-4284-9b19-a72d37db1d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7d57a6a7-82ab-4224-91a1-fe166ad810f5 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created volume successfully. Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (8de8b1aa-e3b5-4640-ac8b-1a536782f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70c309a-3b54-45e4-aa04-3e5e5dc6b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70c309a-3b54-45e4-aa04-3e5e5dc6b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-391759342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec66782c-b3ad-40f2-8503-1d323fa8ee70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:36Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb844986-edf3-4e47-a1fa-522751852c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb844986-edf3-4e47-a1fa-522751852c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5895179a-de70-4bb1-a130-e0bb33eb0e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5895179a-de70-4bb1-a130-e0bb33eb0e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec66782c-b3ad-40f2-8503-1d323fa8ee70', 'volume_name': 'volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee2f3b2-e884-4a61-a236-9918bafb12b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee2f3b2-e884-4a61-a236-9918bafb12b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1928ddf-e2ee-419f-90eb-8ff20f5dc7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:35 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume ec66782c-b3ad-40f2-8503-1d323fa8ee70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70', 'volume_size': 1} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-391759342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec66782c-b3ad-40f2-8503-1d323fa8ee70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:36Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Creating volume ec66782c-b3ad-40f2-8503-1d323fa8ee70 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:35 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:35 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 1073741824 Sep 05 21:05:35 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (cc8faf43-5998-470a-aef1-deb553d3e2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5be7c65-efb7-4d8a-b1f0-535ea4a431a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5be7c65-efb7-4d8a-b1f0-535ea4a431a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575170139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d82c85b-1da5-4443-9b2f-205f045e60f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:36Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85762d9a-9288-4668-b630-22f9c4f29e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85762d9a-9288-4668-b630-22f9c4f29e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867ad320-6074-42d9-bb70-61cd9d7a8691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867ad320-6074-42d9-bb70-61cd9d7a8691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d82c85b-1da5-4443-9b2f-205f045e60f8', 'volume_name': 'volume-0d82c85b-1da5-4443-9b2f-205f045e60f8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd893f76-f0db-4502-902a-388f6f0b465e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd893f76-f0db-4502-902a-388f6f0b465e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b4db85-5304-45e1-8e47-5d2b4a9f9353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:36 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume 0d82c85b-1da5-4443-9b2f-205f045e60f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d82c85b-1da5-4443-9b2f-205f045e60f8', 'volume_size': 1} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:36 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 1073741824" returned: 0 in 0.691s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:36 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 Sep 05 21:05:36 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:36 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (41b79615-8f97-4d9e-b11a-eccd18e3db47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6a7fac-af91-4a9e-904c-761e73359893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6a7fac-af91-4a9e-904c-761e73359893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-5722878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa1b2cc-788f-4735-8771-c43238b20d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:37Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef9ffb3-11c5-4b15-9790-cb0bf1a500a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef9ffb3-11c5-4b15-9790-cb0bf1a500a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a692ea-3884-4fa7-9fec-4f2e3705bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a692ea-3884-4fa7-9fec-4f2e3705bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa1b2cc-788f-4735-8771-c43238b20d47', 'volume_name': 'volume-2fa1b2cc-788f-4735-8771-c43238b20d47', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae0c723-2ea8-4c95-8839-6d1c3deba4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae0c723-2ea8-4c95-8839-6d1c3deba4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872a3471-4ded-4a0d-8704-e33bb66e3dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:37 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume 2fa1b2cc-788f-4735-8771-c43238b20d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa1b2cc-788f-4735-8771-c43238b20d47', 'volume_size': 1} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:37 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70" returned: 0 in 0.530s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575170139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d82c85b-1da5-4443-9b2f-205f045e60f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:36Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Creating volume 0d82c85b-1da5-4443-9b2f-205f045e60f8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:37 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1928ddf-e2ee-419f-90eb-8ff20f5dc7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:37 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 1073741824 Sep 05 21:05:37 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc134551-c2b7-4e24-8951-04e51e5da03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:37 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 (ec66782c-b3ad-40f2-8503-1d323fa8ee70): created successfully Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc134551-c2b7-4e24-8951-04e51e5da03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (8de8b1aa-e3b5-4640-ac8b-1a536782f032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:37 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1b3d3754-4d1b-4f45-bfb8-357257d7a68a tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created volume successfully. Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (826d909c-4a25-45a0-9748-e8c4f53904ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb8d886-9f43-42bd-b049-ad7a9d8c9f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb8d886-9f43-42bd-b049-ad7a9d8c9f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037537853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6663791d-ada9-4a6d-b88e-f1a0d41fe0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:38Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b3c058-c2f5-4643-8648-f73c26293c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b3c058-c2f5-4643-8648-f73c26293c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7def1a-9ba3-4b1f-91f8-ab8aaa96fe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7def1a-9ba3-4b1f-91f8-ab8aaa96fe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6663791d-ada9-4a6d-b88e-f1a0d41fe0d3', 'volume_name': 'volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f769f711-652f-4d57-acaa-27fb81486218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f769f711-652f-4d57-acaa-27fb81486218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a79564b-9098-44af-9918-3172ec031951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume 6663791d-ada9-4a6d-b88e-f1a0d41fe0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3', 'volume_size': 1} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 1073741824" returned: 0 in 0.941s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:38 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 Sep 05 21:05:38 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:38 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8" returned: 0 in 0.333s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.553s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-5722878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa1b2cc-788f-4735-8771-c43238b20d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:37Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Creating volume 2fa1b2cc-788f-4735-8771-c43238b20d47 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:38 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b4db85-5304-45e1-8e47-5d2b4a9f9353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d82c85b-1da5-4443-9b2f-205f045e60f8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f3431-be24-4214-b05c-65ac53be4e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 1073741824 Sep 05 21:05:38 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:38 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 (0d82c85b-1da5-4443-9b2f-205f045e60f8): created successfully Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537f3431-be24-4214-b05c-65ac53be4e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (cc8faf43-5998-470a-aef1-deb553d3e2cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:38 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cd092654-746e-4a91-8472-ca88a3feaebd tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created volume successfully. Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (031df9ea-393a-4fdd-bd60-a5e66f76cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02564da-0771-4289-9bf6-bf7b395e6c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02564da-0771-4289-9bf6-bf7b395e6c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759332784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa56b821-ea32-495f-96f2-af1acd103696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:39Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d88d38-dca2-4cc2-9463-d86395027458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d88d38-dca2-4cc2-9463-d86395027458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eed965-1673-4ece-ac45-81d72bc8ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eed965-1673-4ece-ac45-81d72bc8ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa56b821-ea32-495f-96f2-af1acd103696', 'volume_name': 'volume-aa56b821-ea32-495f-96f2-af1acd103696', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685be11-20ce-4d22-9e8c-32ae28560d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685be11-20ce-4d22-9e8c-32ae28560d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2db136-879d-4379-984e-e3a18d196a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:39 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume aa56b821-ea32-495f-96f2-af1acd103696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa56b821-ea32-495f-96f2-af1acd103696', 'volume_size': 1} Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:39 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 1073741824" returned: 0 in 0.748s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:39 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 Sep 05 21:05:39 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:39 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47" returned: 0 in 0.481s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037537853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6663791d-ada9-4a6d-b88e-f1a0d41fe0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:38Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Creating volume 6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:40 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:40 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 1073741824 Sep 05 21:05:40 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872a3471-4ded-4a0d-8704-e33bb66e3dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa1b2cc-788f-4735-8771-c43238b20d47', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9137b0e-50f6-4de2-91e5-ec5734efa138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume volume-2fa1b2cc-788f-4735-8771-c43238b20d47 (2fa1b2cc-788f-4735-8771-c43238b20d47): created successfully Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9137b0e-50f6-4de2-91e5-ec5734efa138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (41b79615-8f97-4d9e-b11a-eccd18e3db47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-57d8919d-c622-4d28-be53-45a3e2cd7fee tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created volume successfully. Sep 05 21:05:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-092a3cf8-8454-46cb-97bd-8d28d7774ec0 tempest-TestShelveInstance-1463649249 None] Terminate volume connection completed successfully. Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-092a3cf8-8454-46cb-97bd-8d28d7774ec0 tempest-TestShelveInstance-1463649249 None] Deleting attachment 3379874e-e48c-415c-aab7-13fafa3c7a70. {{(pid=87778) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Acquiring lock "cinder-92d80265-241f-45b1-b19e-301ce1fd26f2-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Lock "cinder-92d80265-241f-45b1-b19e-301ce1fd26f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Acquiring lock "cinder-quobyte-92d80265-241f-45b1-b19e-301ce1fd26f2" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Lock "cinder-quobyte-92d80265-241f-45b1-b19e-301ce1fd26f2" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34be3e8-8fe5-4510-abfb-0011f48b13ce]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:40 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 1073741824" returned: 0 in 0.604s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:40 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 Sep 05 21:05:40 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:40 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 Sep 05 21:05:40 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:41 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3" returned: 0 in 0.340s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759332784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa56b821-ea32-495f-96f2-af1acd103696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1cec51fec24489d82b389340c417514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:39Z,use_quota=True,user_id='71ccbe95ee594f6eb7ec7f935c72db06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Creating volume aa56b821-ea32-495f-96f2-af1acd103696 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:41 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:41 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 1073741824 Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a79564b-9098-44af-9918-3172ec031951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:41 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e1be40-ee94-415e-ae10-9b9d639d98af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 (6663791d-ada9-4a6d-b88e-f1a0d41fe0d3): created successfully Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e1be40-ee94-415e-ae10-9b9d639d98af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (826d909c-4a25-45a0-9748-e8c4f53904ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:41 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-723f9ed9-f72d-4971-b2ab-3ebdb4a2dcfa tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created volume successfully. Sep 05 21:05:41 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2" returned: 0 in 0.649s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:41 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2 Sep 05 21:05:41 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:41 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-92d80265-241f-45b1-b19e-301ce1fd26f2" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Lock "cinder-quobyte-92d80265-241f-45b1-b19e-301ce1fd26f2" released by "delete_volume" :: held 1.108s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.quota [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Created reservations ['35087b0a-98dc-4b00-a117-8cea82ae6292', 'b705a8cb-e432-4ac7-a2e5-2d5529e423b2', '97c24de4-65ef-4914-b24c-a3eccac8c084', 'fd9f957b-dd6a-4248-90b0-3bf3e9d5b120'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:41 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:41 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:41 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 1073741824" returned: 0 in 0.823s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:42 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 Sep 05 21:05:42 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:42 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.502s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG cinder.manager [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Deleted volume successfully. Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [req-b42a53e9-dfcf-4a8a-81f9-1a35ba6a3e36 req-2189c2e4-4a51-45cd-a488-b981a82e9c98 tempest-TestShelveInstance-1463649249 None] Lock "cinder-92d80265-241f-45b1-b19e-301ce1fd26f2-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:42 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696" returned: 0 in 0.496s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2db136-879d-4379-984e-e3a18d196a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa56b821-ea32-495f-96f2-af1acd103696', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c7f41b-bbad-43e9-a96e-81239e92272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:42 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Volume volume-aa56b821-ea32-495f-96f2-af1acd103696 (aa56b821-ea32-495f-96f2-af1acd103696): created successfully Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c7f41b-bbad-43e9-a96e-81239e92272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Flow 'volume_create_manager' (031df9ea-393a-4fdd-bd60-a5e66f76cd19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-874182e9-3845-4e8d-bb93-17710f23b9fb tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created volume successfully. Sep 05 21:05:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-aa56b821-ea32-495f-96f2-af1acd103696-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-aa56b821-ea32-495f-96f2-af1acd103696-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-quobyte-aa56b821-ea32-495f-96f2-af1acd103696" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-aa56b821-ea32-495f-96f2-af1acd103696" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[697fa042-be3d-435f-a70f-42f05f6f2c61]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:43 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 Sep 05 21:05:43 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:44 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696" returned: 0 in 0.416s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:44 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696 Sep 05 21:05:44 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:44 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-aa56b821-ea32-495f-96f2-af1acd103696" returned: 0 in 0.287s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-aa56b821-ea32-495f-96f2-af1acd103696" released by "delete_volume" :: held 0.760s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created reservations ['4e934f61-b092-4e70-a273-7d05b3d674f2', '2dd0b40a-ee0c-4b8a-a8a8-d6a13eec521d', 'f9a1b5dd-2886-4e95-9674-2c4c13138441', 'b2352228-4fbd-4d8b-93cf-d8d6b9171f30'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:44 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:44 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-quobyte-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3" acquired by "delete_volume" :: waited 0.047s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1bd0a7-f567-47da-a68e-f59ba8167cad]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:44 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.384s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:44 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Deleted volume successfully. Sep 05 21:05:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bf48a6ec-7202-4d08-a2aa-ac1236e7326c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-aa56b821-ea32-495f-96f2-af1acd103696-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:45 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 Sep 05 21:05:45 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Flow 'volume_create_manager' (31d526f1-2418-403f-a988-823b2d821336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd0320-4e06-4cd6-85cf-610b8b003960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd0320-4e06-4cd6-85cf-610b8b003960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1521409550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fb416f-5c37-4fee-96e5-c1d1c78289a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855825d412e54553967f88041d5ed6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:45Z,use_quota=True,user_id='6a51f99627d549389e14a2c62d6bb576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abda75e2-165e-4841-bf1a-7309234325b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abda75e2-165e-4841-bf1a-7309234325b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:45 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5217c224-5972-492d-b3da-7435972fc828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5217c224-5972-492d-b3da-7435972fc828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fb416f-5c37-4fee-96e5-c1d1c78289a4', 'volume_name': 'volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f04477f-da2f-4402-aace-e789794826e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f04477f-da2f-4402-aace-e789794826e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c87caa-f837-48ce-a6f5-ef7da432b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:45 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Volume 23fb416f-5c37-4fee-96e5-c1d1c78289a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4', 'volume_size': 1} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1521409550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fb416f-5c37-4fee-96e5-c1d1c78289a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855825d412e54553967f88041d5ed6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:45Z,use_quota=True,user_id='6a51f99627d549389e14a2c62d6bb576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Creating volume 23fb416f-5c37-4fee-96e5-c1d1c78289a4 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:45 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3" returned: 0 in 0.535s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:45 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 1073741824 Sep 05 21:05:45 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:45 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3 Sep 05 21:05:45 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:45 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3" returned: 0 in 0.311s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3" released by "delete_volume" :: held 0.916s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created reservations ['4e0767ce-db87-43e4-9984-b8df06c8dd36', 'e1028bfc-2a85-40dd-a096-1b59dbc10cab', 'b728feaa-0eca-48b5-a124-3e40ab59c7d1', '67f68f04-b808-4e87-9ad9-ca54df79bde8'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:45 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 1073741824" returned: 0 in 0.437s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:45 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 Sep 05 21:05:45 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:45 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:45 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-2fa1b2cc-788f-4735-8771-c43238b20d47-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-2fa1b2cc-788f-4735-8771-c43238b20d47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-quobyte-2fa1b2cc-788f-4735-8771-c43238b20d47" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-2fa1b2cc-788f-4735-8771-c43238b20d47" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[802b30b5-9120-46fa-bb1c-22f1224cc3d5]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:46 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 Sep 05 21:05:46 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:46 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c87caa-f837-48ce-a6f5-ef7da432b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47fa466-a094-47e3-b534-06d82b24f329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Volume volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 (23fb416f-5c37-4fee-96e5-c1d1c78289a4): created successfully Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47fa466-a094-47e3-b534-06d82b24f329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:46 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Flow 'volume_create_manager' (31d526f1-2418-403f-a988-823b2d821336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.442s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Deleted volume successfully. Sep 05 21:05:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8e3065ad-ebe9-42bf-9e36-373bd0de01b2 tempest-VolumesTransfersV355Test-1960323894 None] Created volume successfully. Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1944e158-ccc4-46b6-b3b2-aa11b8ea7c56 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-6663791d-ada9-4a6d-b88e-f1a0d41fe0d3-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:46 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47" returned: 0 in 0.467s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:46 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47 Sep 05 21:05:46 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:46 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-2fa1b2cc-788f-4735-8771-c43238b20d47" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-2fa1b2cc-788f-4735-8771-c43238b20d47" released by "delete_volume" :: held 0.764s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created reservations ['dca262f4-f43d-49e0-8eb2-45d03d1aff06', 'e3edadff-a16a-45b1-b6b1-dc8537141637', 'eae35b58-150c-47f9-9077-24a2a8df1f75', 'd2035fbf-fbf5-465c-ba12-7b81c6e7be0f'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:46 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:46 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-0d82c85b-1da5-4443-9b2f-205f045e60f8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:47 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.300s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Deleted volume successfully. Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-0d82c85b-1da5-4443-9b2f-205f045e60f8-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=115,cinder:INSERT=36,cinder:UPDATE=135,cinder:DELETE=15 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=127,cinder:SELECT=96,cinder:DELETE=7,cinder:INSERT=36 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-12f41124-63e8-4cb2-ac42-91be5d459260 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-2fa1b2cc-788f-4735-8771-c43238b20d47-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-quobyte-0d82c85b-1da5-4443-9b2f-205f045e60f8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-0d82c85b-1da5-4443-9b2f-205f045e60f8" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9992a4f5-8350-4fee-944f-5c11d65d6de6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:47 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 Sep 05 21:05:47 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:47 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8" returned: 0 in 0.440s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:47 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8 Sep 05 21:05:47 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:48 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0d82c85b-1da5-4443-9b2f-205f045e60f8" returned: 0 in 0.292s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-0d82c85b-1da5-4443-9b2f-205f045e60f8" released by "delete_volume" :: held 0.788s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7048d4f9-c50a-4513-8059-61762f36f71f tempest-VolumesTransfersV355Test-1868356222 None] Transfer volume completed successfully. Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created reservations ['a6f0e46a-ae67-489e-8b61-4e4aca81f4ae', '99ca52f9-b1e9-45b3-b014-23fcd309555f', '540931bd-7750-47ff-b169-eb0fbc147975', 'c5c98b41-a5df-48f6-ad87-73d6e551391a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:48 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:48 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-ec66782c-b3ad-40f2-8503-1d323fa8ee70-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-ec66782c-b3ad-40f2-8503-1d323fa8ee70-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-quobyte-ec66782c-b3ad-40f2-8503-1d323fa8ee70" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-ec66782c-b3ad-40f2-8503-1d323fa8ee70" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3858200-49d2-498b-85af-519ba63c3f27]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:48 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.355s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Deleted volume successfully. Sep 05 21:05:48 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 Sep 05 21:05:48 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0d9f43c-37f3-40a2-a864-bf550b57cd35 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-0d82c85b-1da5-4443-9b2f-205f045e60f8-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Acquiring lock "cinder-23fb416f-5c37-4fee-96e5-c1d1c78289a4-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-23fb416f-5c37-4fee-96e5-c1d1c78289a4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Acquiring lock "cinder-quobyte-23fb416f-5c37-4fee-96e5-c1d1c78289a4" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-quobyte-23fb416f-5c37-4fee-96e5-c1d1c78289a4" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:49 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70" returned: 0 in 0.472s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eee538d-b770-493d-b939-63ea260a3523]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:49 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70 Sep 05 21:05:49 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:49 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 Sep 05 21:05:49 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:49 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ec66782c-b3ad-40f2-8503-1d323fa8ee70" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-ec66782c-b3ad-40f2-8503-1d323fa8ee70" released by "delete_volume" :: held 0.841s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created reservations ['99b66302-62ee-476b-aaf2-a65219e4ab93', '7e2b11d7-bb23-450e-b0e1-45068a62329a', '10645f50-f801-4539-81be-7e3e71661557', '1aedd6c1-c2c9-4b4a-b1b9-89fcde80f197'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:49 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4" returned: 0 in 0.420s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:49 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4 Sep 05 21:05:49 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:49 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:49 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-89286ee8-cf33-46e3-a85b-5e879ad7fc17-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-89286ee8-cf33-46e3-a85b-5e879ad7fc17-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "cinder-quobyte-89286ee8-cf33-46e3-a85b-5e879ad7fc17" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-89286ee8-cf33-46e3-a85b-5e879ad7fc17" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5946b632-eca1-4131-9025-31a6e6b3de69]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:49 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-23fb416f-5c37-4fee-96e5-c1d1c78289a4" returned: 0 in 0.334s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-quobyte-23fb416f-5c37-4fee-96e5-c1d1c78289a4" released by "delete_volume" :: held 0.810s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:49 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Created reservations ['391098fd-176a-45c6-beab-b92620252c56', 'dec4c901-55be-46cf-8ed9-4d275f44a21b', '7b6719da-60f2-4862-b205-f13d5a0cf994', '9f725cec-5167-48cc-96a2-cd822086b08c'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:49 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.370s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:49 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:49 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Deleted volume successfully. Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7211cf1b-3c98-4a64-98ff-4208587a674c tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-ec66782c-b3ad-40f2-8503-1d323fa8ee70-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:50 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:50 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:50 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17" returned: 0 in 0.523s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:50 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17 Sep 05 21:05:50 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:50 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Deleted volume successfully. Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1f882fe4-98e6-4bfe-bedc-1be416b94cfe tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-23fb416f-5c37-4fee-96e5-c1d1c78289a4-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:50 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-89286ee8-cf33-46e3-a85b-5e879ad7fc17" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-quobyte-89286ee8-cf33-46e3-a85b-5e879ad7fc17" released by "delete_volume" :: held 0.897s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Created reservations ['38370437-89b9-453b-9ceb-7d2909dea73f', '6dac5a6d-9dc3-487b-8875-3a4f89b1c9fa', 'ec1b45d1-89f9-4f88-9980-a496e868d014', '3647e08f-5797-4a02-8bec-c9555ae8449c'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Flow 'volume_create_manager' (68934ea2-2548-4094-af0d-7764d2489abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb250c84-1aa4-4295-9262-6a1c9cf54380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb250c84-1aa4-4295-9262-6a1c9cf54380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-692672953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344e8a62-cefd-424e-9896-5eec9d6a87f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855825d412e54553967f88041d5ed6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:51Z,use_quota=True,user_id='6a51f99627d549389e14a2c62d6bb576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641272d0-be01-4342-8ce0-4bc1b6705f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641272d0-be01-4342-8ce0-4bc1b6705f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f39e4fe-18fd-48bb-8a16-6e691fb44dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f39e4fe-18fd-48bb-8a16-6e691fb44dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344e8a62-cefd-424e-9896-5eec9d6a87f5', 'volume_name': 'volume-344e8a62-cefd-424e-9896-5eec9d6a87f5', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715661a9-1b12-4001-96a1-ae295de9f064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715661a9-1b12-4001-96a1-ae295de9f064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7f0ba2-4816-4db3-8942-c029373bd365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:50 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Volume 344e8a62-cefd-424e-9896-5eec9d6a87f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344e8a62-cefd-424e-9896-5eec9d6a87f5', 'volume_size': 1} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-692672953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344e8a62-cefd-424e-9896-5eec9d6a87f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855825d412e54553967f88041d5ed6e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:51Z,use_quota=True,user_id='6a51f99627d549389e14a2c62d6bb576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Creating volume 344e8a62-cefd-424e-9896-5eec9d6a87f5 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:05:50 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:50 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 1073741824 Sep 05 21:05:50 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:51 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:51 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:51 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.252s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Deleted volume successfully. Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7f229efa-e578-4684-8dd3-195d09603ef4 tempest-CreateVolumesFromSourceVolumeTest-361290408 None] Lock "cinder-89286ee8-cf33-46e3-a85b-5e879ad7fc17-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:51 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 1073741824" returned: 0 in 0.495s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:51 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 Sep 05 21:05:51 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:51 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5" returned: 0 in 0.268s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7f0ba2-4816-4db3-8942-c029373bd365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344e8a62-cefd-424e-9896-5eec9d6a87f5', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd98d2ae-e20f-468a-b58c-e53766e26041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:51 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Volume volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 (344e8a62-cefd-424e-9896-5eec9d6a87f5): created successfully Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd98d2ae-e20f-468a-b58c-e53766e26041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Flow 'volume_create_manager' (68934ea2-2548-4094-af0d-7764d2489abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5eb8e453-b547-4160-bfd9-5222ce3f8ab1 tempest-VolumesTransfersV355Test-1960323894 None] Created volume successfully. Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Acquiring lock "cinder-344e8a62-cefd-424e-9896-5eec9d6a87f5-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-344e8a62-cefd-424e-9896-5eec9d6a87f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Acquiring lock "cinder-quobyte-344e8a62-cefd-424e-9896-5eec9d6a87f5" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-quobyte-344e8a62-cefd-424e-9896-5eec9d6a87f5" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e2cf7b-a5c9-40ba-b012-d3c96fa4b852]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:53 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 Sep 05 21:05:53 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:53 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5" returned: 0 in 0.456s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:53 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5 Sep 05 21:05:53 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:54 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-344e8a62-cefd-424e-9896-5eec9d6a87f5" returned: 0 in 0.287s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-quobyte-344e8a62-cefd-424e-9896-5eec9d6a87f5" released by "delete_volume" :: held 0.819s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Created reservations ['3a975edd-e49a-4885-99f9-00c49c981128', '47aab7b3-2fc3-449d-999e-1f46714176c2', '7481e35c-acc9-4827-be2a-498a8921ec85', 'bac8a336-cf5b-41a0-a419-2c3469e3c463'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:54 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:05:54 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:05:54 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.318s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:05:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Deleted volume successfully. Sep 05 21:05:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c0173d7a-f4b1-4e8a-81c5-0836f53bea40 tempest-VolumesTransfersV355Test-778223061 None] Lock "cinder-344e8a62-cefd-424e-9896-5eec9d6a87f5-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Flow 'volume_create_manager' (4ae9acd4-1182-451b-8e62-d1494e3bf1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69837804-2758-4fda-9a07-c21cf7e33ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69837804-2758-4fda-9a07-c21cf7e33ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416e3314-4e73-435a-8588-9175da0a964a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4221f5bb4914bc5a99752fc31e84633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:59Z,use_quota=True,user_id='d03f5dedbb1f4d97aab1201a452060bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dd1352-1800-4e9e-88ca-56993c2f6c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dd1352-1800-4e9e-88ca-56993c2f6c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9afdef-c38c-44b7-a640-d9155340b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df9afdef-c38c-44b7-a640-d9155340b468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '416e3314-4e73-435a-8588-9175da0a964a', 'volume_name': 'volume-416e3314-4e73-435a-8588-9175da0a964a', 'volume_size': 1, 'image_id': '51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01cb805232b020e6f2d431c1ce8ca3ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4221f5bb4914bc5a99752fc31e84633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d1922a8c5b1a4ef4277f6f1ac4f22868869c026790dbd6d76bb9fdc49cd7a5dd5430e740a57311a3d8b93d3e9540c39e475f2f77ba435e6f660f073757da8f7', 'id': '51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'created_at': datetime.datetime(2026, 9, 5, 19, 5, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb/file', 'properties': {}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571aac79-58db-4d1c-93df-335d5089b82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571aac79-58db-4d1c-93df-335d5089b82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45bfcebd-3be7-47bb-9b2b-968f878cef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:05:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Volume 416e3314-4e73-435a-8588-9175da0a964a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-416e3314-4e73-435a-8588-9175da0a964a', 'volume_size': 1, 'image_id': '51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01cb805232b020e6f2d431c1ce8ca3ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4221f5bb4914bc5a99752fc31e84633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d1922a8c5b1a4ef4277f6f1ac4f22868869c026790dbd6d76bb9fdc49cd7a5dd5430e740a57311a3d8b93d3e9540c39e475f2f77ba435e6f660f073757da8f7', 'id': '51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'created_at': datetime.datetime(2026, 9, 5, 19, 5, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb/file', 'properties': {}}, 'image_service': } Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Trying to clone 416e3314-4e73-435a-8588-9175da0a964a from image 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:05:59 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c712f2e9-f441-471c-9a5f-391aad51e0ca]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:05:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:05:59 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD Sep 05 21:05:59 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:00 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:00 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD Sep 05 21:06:00 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:00 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Temporary image 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb is fetched for user d03f5dedbb1f4d97aab1201a452060bb. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a013c-8ab4-42da-8c09-96c61bca652c]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:00 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD Sep 05 21:06:00 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:00 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:01 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD Sep 05 21:06:01 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:01 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416e3314-4e73-435a-8588-9175da0a964a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4221f5bb4914bc5a99752fc31e84633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:05:59Z,use_quota=True,user_id='d03f5dedbb1f4d97aab1201a452060bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Creating volume 416e3314-4e73-435a-8588-9175da0a964a {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:01 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:01 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a 1073741824 Sep 05 21:06:01 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:01 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a 1073741824" returned: 0 in 0.524s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:01 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a Sep 05 21:06:01 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Flow 'volume_create_manager' (5a4a330c-2eef-47f3-9b07-3d97f1accb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9a0c3f-b96d-4a8f-aafd-3460ec9d3f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9a0c3f-b96d-4a8f-aafd-3460ec9d3f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-847753763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db0840d-2b72-4029-ab4f-9b9a7b762d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d55e76176c49c99effc22292187c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:02Z,use_quota=True,user_id='e4e28db425d248ab873d0e4637a065be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7b693b-ffe9-4f9f-83ea-cc051f5193eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7b693b-ffe9-4f9f-83ea-cc051f5193eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd00c19-6cc9-4ad8-8867-b5b1f26bf699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd00c19-6cc9-4ad8-8867-b5b1f26bf699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db0840d-2b72-4029-ab4f-9b9a7b762d78', 'volume_name': 'volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6dd51e-0582-44cb-965e-c7aff5f908c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6dd51e-0582-44cb-965e-c7aff5f908c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b93a70-867a-468c-a39e-833c72c6e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Volume 7db0840d-2b72-4029-ab4f-9b9a7b762d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78', 'volume_size': 1} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a" returned: 0 in 0.326s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-847753763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db0840d-2b72-4029-ab4f-9b9a7b762d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d55e76176c49c99effc22292187c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:02Z,use_quota=True,user_id='e4e28db425d248ab873d0e4637a065be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Creating volume 7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:02 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:02 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 1073741824 Sep 05 21:06:02 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Attempting download of 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb ((None, [{'url': 'file:///opt/stack/data/glance/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'metadata': {}}])) to volume 416e3314-4e73-435a-8588-9175da0a964a. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c1656f-b18f-421d-add5-af8cbdd839cd]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_jck4l2c_ {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Flow 'volume_create_manager' (bdeaeff8-7ca5-4fd4-af6e-7c3dd8f5c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1747c223-5915-4fe8-b8c5-8b7298e849fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_jck4l2c_ Sep 05 21:06:02 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1747c223-5915-4fe8-b8c5-8b7298e849fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a494d-da94-4f97-9a09-4f0c65fcb835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4911aaffbabb48e5806be98a0c1e2ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:02Z,use_quota=True,user_id='154a158d78dc44be8baff2f089df3be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5af92069-434b-456a-97cc-d7ae4e325003),volume_type_id=5af92069-434b-456a-97cc-d7ae4e325003)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52849e03-cd0e-44f6-966c-3e710be57b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52849e03-cd0e-44f6-966c-3e710be57b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96570f8e-2a2c-4514-8feb-1e39308f163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:06:02 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_jck4l2c_" returned: 0 in 0.379s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_jck4l2c_ {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:02 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 1073741824" returned: 0 in 0.537s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96570f8e-2a2c-4514-8feb-1e39308f163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b01a494d-da94-4f97-9a09-4f0c65fcb835', 'volume_name': 'volume-b01a494d-da94-4f97-9a09-4f0c65fcb835', 'volume_size': 1, 'image_id': 'b0941a58-b392-44c0-aabd-b05a043de9b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0941a58-b392-44c0-aabd-b05a043de9b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bb0994a9708b7835931f556b71f9d6c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4911aaffbabb48e5806be98a0c1e2ecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f683a97b20de7968c4e40b37c5e8c972a9dc88435c2d34cc8f12c281e08eed102a41d48e6ecb21a245ab428b70253dbe3b0a719f00c00d2d2395d25addb42ddb', 'id': 'b0941a58-b392-44c0-aabd-b05a043de9b2', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0941a58-b392-44c0-aabd-b05a043de9b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9932d05b-e99a-4eb9-85db-6bfa9d465f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9932d05b-e99a-4eb9-85db-6bfa9d465f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253fa2b4-9eac-4e43-8d41-741f5d0e8cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Volume b01a494d-da94-4f97-9a09-4f0c65fcb835: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b01a494d-da94-4f97-9a09-4f0c65fcb835', 'volume_size': 1, 'image_id': 'b0941a58-b392-44c0-aabd-b05a043de9b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0941a58-b392-44c0-aabd-b05a043de9b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bb0994a9708b7835931f556b71f9d6c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4911aaffbabb48e5806be98a0c1e2ecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f683a97b20de7968c4e40b37c5e8c972a9dc88435c2d34cc8f12c281e08eed102a41d48e6ecb21a245ab428b70253dbe3b0a719f00c00d2d2395d25addb42ddb', 'id': 'b0941a58-b392-44c0-aabd-b05a043de9b2', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0941a58-b392-44c0-aabd-b05a043de9b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Trying to clone b01a494d-da94-4f97-9a09-4f0c65fcb835 from image b0941a58-b392-44c0-aabd-b05a043de9b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0941a58-b392-44c0-aabd-b05a043de9b2', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:06:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:02 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_jck4l2c_ Sep 05 21:06:02 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:02 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 Sep 05 21:06:02 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:06:03 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c54a11-cf43-4374-a13f-66bdadc05cb4]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:03 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD Sep 05 21:06:03 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:03 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78" returned: 0 in 0.288s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:03 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_jck4l2c_" returned: 1 in 0.401s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_jck4l2c_' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[430e8084-e69d-4c6c-b5c7-dbe76474a30c]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b93a70-867a-468c-a39e-833c72c6e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367b1343-b28d-4794-aaaa-9c8763f17ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Volume volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 (7db0840d-2b72-4029-ab4f-9b9a7b762d78): created successfully Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367b1343-b28d-4794-aaaa-9c8763f17ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Flow 'volume_create_manager' (5a4a330c-2eef-47f3-9b07-3d97f1accb67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-689f5e61-bd0f-47b7-b1dd-782e14503305 tempest-VolumesCloneTest-869872333 None] Created volume successfully. Sep 05 21:06:03 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD Sep 05 21:06:03 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:03 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:03 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD Sep 05 21:06:03 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:03 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:03 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD Sep 05 21:06:03 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:03 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Temporary image b0941a58-b392-44c0-aabd-b05a043de9b2 is fetched for user 154a158d78dc44be8baff2f089df3be7. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[524da40b-a0a0-4399-8275-068a11be20f2]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:03 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb was raw, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:06:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:03 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a Sep 05 21:06:03 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:04 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD Sep 05 21:06:04 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:04 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:04 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD Sep 05 21:06:04 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:04 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a" returned: 0 in 0.669s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_51682e7c-9f1a-407d-ba4c-a4ee0d7312eb_k1ktobs3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:06:04 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:04 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a 1G Sep 05 21:06:04 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:04 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD" returned: 1 in 0.442s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b01a494d-da94-4f97-9a09-4f0c65fcb835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4911aaffbabb48e5806be98a0c1e2ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:02Z,use_quota=True,user_id='154a158d78dc44be8baff2f089df3be7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5af92069-434b-456a-97cc-d7ae4e325003),volume_type_id=5af92069-434b-456a-97cc-d7ae4e325003)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Creating volume b01a494d-da94-4f97-9a09-4f0c65fcb835 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:04 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:04 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 1073741824 Sep 05 21:06:04 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:04 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:04 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:04 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Flow 'volume_create_manager' (499307e7-595c-4c84-b1eb-93b4a9ab35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c4c764-5306-4984-8f17-65344a097ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c4c764-5306-4984-8f17-65344a097ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1209905192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78c890c-ff4e-4c6f-9e45-b0ef486abe84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1d55e76176c49c99effc22292187c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7db0840d-2b72-4029-ab4f-9b9a7b762d78,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:05Z,use_quota=True,user_id='e4e28db425d248ab873d0e4637a065be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:05 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8714074-0c78-46c7-8492-2a8a1f8ba873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8714074-0c78-46c7-8492-2a8a1f8ba873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eef7d5f-bceb-449f-90cd-14b8429a55af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a 1G" returned: 0 in 0.415s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Downloaded image 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb ((None, [{'url': 'file:///opt/stack/data/glance/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'metadata': {}}])) to volume 416e3314-4e73-435a-8588-9175da0a964a successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Temporary image 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb for user d03f5dedbb1f4d97aab1201a452060bb is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Marking volume 416e3314-4e73-435a-8588-9175da0a964a as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eef7d5f-bceb-449f-90cd-14b8429a55af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd78c890c-ff4e-4c6f-9e45-b0ef486abe84', 'volume_name': 'volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84', 'volume_size': 2, 'source_volid': '7db0840d-2b72-4029-ab4f-9b9a7b762d78', 'source_volstatus': 'available'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b11992f-1452-4558-9d41-b287a6cc1e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b11992f-1452-4558-9d41-b287a6cc1e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd021556-0bb7-4e7b-93d3-e3cda75db266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:05 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Volume d78c890c-ff4e-4c6f-9e45-b0ef486abe84: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84', 'volume_size': 2, 'source_volid': '7db0840d-2b72-4029-ab4f-9b9a7b762d78', 'source_volstatus': 'available'} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Copying metadata from image 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb to 416e3314-4e73-435a-8588-9175da0a964a. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Creating volume glance metadata for volume 416e3314-4e73-435a-8588-9175da0a964a backed by image 51682e7c-9f1a-407d-ba4c-a4ee0d7312eb with: {'image_id': '51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '01cb805232b020e6f2d431c1ce8ca3ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45bfcebd-3be7-47bb-9b2b-968f878cef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416e3314-4e73-435a-8588-9175da0a964a', 'volume_size': 1, 'image_id': '51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01cb805232b020e6f2d431c1ce8ca3ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4221f5bb4914bc5a99752fc31e84633', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d1922a8c5b1a4ef4277f6f1ac4f22868869c026790dbd6d76bb9fdc49cd7a5dd5430e740a57311a3d8b93d3e9540c39e475f2f77ba435e6f660f073757da8f7', 'id': '51682e7c-9f1a-407d-ba4c-a4ee0d7312eb', 'created_at': datetime.datetime(2026, 9, 5, 19, 5, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 5, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/51682e7c-9f1a-407d-ba4c-a4ee0d7312eb/file', 'properties': {}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6cb969-3ed5-40c6-a828-e36508c10b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:05 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Volume volume-416e3314-4e73-435a-8588-9175da0a964a (416e3314-4e73-435a-8588-9175da0a964a): created successfully Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6cb969-3ed5-40c6-a828-e36508c10b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Flow 'volume_create_manager' (4ae9acd4-1182-451b-8e62-d1494e3bf1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b9c75d3a-ac8e-4a38-8aef-6ad9390350d6 tempest-VolumeImageDependencyTests-775444290 None] Created volume successfully. Sep 05 21:06:05 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:06:05 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 1073741824" returned: 0 in 0.536s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:05 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 Sep 05 21:06:05 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:05 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.491s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:05 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Cloning volume 7db0840d-2b72-4029-ab4f-9b9a7b762d78 to volume d78c890c-ff4e-4c6f-9e45-b0ef486abe84 Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Creating offline snapshot 9453a4bc-52d1-4552-b5ff-8269e9f51c51 of volume 7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Attempting download of b0941a58-b392-44c0-aabd-b05a043de9b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b0941a58-b392-44c0-aabd-b05a043de9b2', 'metadata': {}}])) to volume b01a494d-da94-4f97-9a09-4f0c65fcb835. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a1ce2b-0861-44d2-b459-b7d80d9f2836]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0fd45-bdc9-4217-8e6c-0c11340ab8a0]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0941a58-b392-44c0-aabd-b05a043de9b2_lx61tp7n {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:05 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 Sep 05 21:06:05 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Acquiring lock "cinder-416e3314-4e73-435a-8588-9175da0a964a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Lock "cinder-416e3314-4e73-435a-8588-9175da0a964a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:05 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0941a58-b392-44c0-aabd-b05a043de9b2_lx61tp7n Sep 05 21:06:05 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Acquiring lock "cinder-quobyte-416e3314-4e73-435a-8588-9175da0a964a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Lock "cinder-quobyte-416e3314-4e73-435a-8588-9175da0a964a" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0d7557-51df-4253-b495-b9979a973b2c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a Sep 05 21:06:06 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0941a58-b392-44c0-aabd-b05a043de9b2_lx61tp7n" returned: 0 in 0.392s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0941a58-b392-44c0-aabd-b05a043de9b2_lx61tp7n {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78" returned: 0 in 0.451s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 1G Sep 05 21:06:06 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0941a58-b392-44c0-aabd-b05a043de9b2_lx61tp7n Sep 05 21:06:06 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a" returned: 0 in 0.370s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a Sep 05 21:06:06 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0941a58-b392-44c0-aabd-b05a043de9b2_lx61tp7n" returned: 1 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0941a58-b392-44c0-aabd-b05a043de9b2_lx61tp7n' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b65c800-7217-4be4-a260-9de2d6678c53]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:06 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 1G" returned: 0 in 0.395s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 Sep 05 21:06:06 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-416e3314-4e73-435a-8588-9175da0a964a" returned: 0 in 0.279s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD Sep 05 21:06:06 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Lock "cinder-quobyte-416e3314-4e73-435a-8588-9175da0a964a" released by "delete_volume" :: held 0.721s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Created reservations ['b4d7fc61-f30a-4bc7-adc0-335b745444d5', '26ca6a2e-733d-41db-819b-33a91b2b72b4', '1445512f-d10f-4cae-8930-6694fd7f64fd', '6c6f2d9e-066b-4915-8d51-bb989d0ef502'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:06 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:06 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 is being set with open permissions: ugo+rw Sep 05 21:06:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:06 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 Sep 05 21:06:06 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:06 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD Sep 05 21:06:06 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:07 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.313s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Deleted volume successfully. Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7997eec8-c111-4c14-9e37-58b904108bb5 tempest-VolumeImageDependencyTests-775444290 None] Lock "cinder-416e3314-4e73-435a-8588-9175da0a964a-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:07 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:07 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] b0941a58-b392-44c0-aabd-b05a043de9b2 was raw, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:07 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.info Sep 05 21:06:07 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:07 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 Sep 05 21:06:07 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:07 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.info" returned: 0 in 0.294s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:07 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.info is being set with open permissions: ugo+rw Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:07 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.info Sep 05 21:06:07 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:07 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.info" returned: 0 in 0.288s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Acquiring lock "cinder-quobyte-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:07 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835" returned: 0 in 0.598s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0941a58-b392-44c0-aabd-b05a043de9b2_rhtvtrnpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:06:07 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] snapshot: 9453a4bc-52d1-4552-b5ff-8269e9f51c51, volume: d78c890c-ff4e-4c6f-9e45-b0ef486abe84, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:06:07 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 1G Sep 05 21:06:07 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e49e20e-4bac-4008-8642-763efe76cd88]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:08 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 Sep 05 21:06:08 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:08 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 1G" returned: 0 in 0.423s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Downloaded image b0941a58-b392-44c0-aabd-b05a043de9b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b0941a58-b392-44c0-aabd-b05a043de9b2', 'metadata': {}}])) to volume b01a494d-da94-4f97-9a09-4f0c65fcb835 successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Temporary image b0941a58-b392-44c0-aabd-b05a043de9b2 for user 154a158d78dc44be8baff2f089df3be7 is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Marking volume b01a494d-da94-4f97-9a09-4f0c65fcb835 as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Copying metadata from image b0941a58-b392-44c0-aabd-b05a043de9b2 to b01a494d-da94-4f97-9a09-4f0c65fcb835. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Creating volume glance metadata for volume b01a494d-da94-4f97-9a09-4f0c65fcb835 backed by image b0941a58-b392-44c0-aabd-b05a043de9b2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b0941a58-b392-44c0-aabd-b05a043de9b2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bb0994a9708b7835931f556b71f9d6c7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253fa2b4-9eac-4e43-8d41-741f5d0e8cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b01a494d-da94-4f97-9a09-4f0c65fcb835', 'volume_size': 1, 'image_id': 'b0941a58-b392-44c0-aabd-b05a043de9b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0941a58-b392-44c0-aabd-b05a043de9b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bb0994a9708b7835931f556b71f9d6c7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4911aaffbabb48e5806be98a0c1e2ecd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f683a97b20de7968c4e40b37c5e8c972a9dc88435c2d34cc8f12c281e08eed102a41d48e6ecb21a245ab428b70253dbe3b0a719f00c00d2d2395d25addb42ddb', 'id': 'b0941a58-b392-44c0-aabd-b05a043de9b2', 'created_at': datetime.datetime(2026, 9, 5, 19, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 6, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0941a58-b392-44c0-aabd-b05a043de9b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221233ee-7011-4831-941d-45f83fe7bcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:08 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Volume volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 (b01a494d-da94-4f97-9a09-4f0c65fcb835): created successfully Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221233ee-7011-4831-941d-45f83fe7bcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:08 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Flow 'volume_create_manager' (bdeaeff8-7ca5-4fd4-af6e-7c3dd8f5c05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51" returned: 0 in 0.501s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:06:08 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d49f7578-adbd-429b-9d2b-04b72f52d20f tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Created volume successfully. Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f89d3b6-b757-4592-8713-fd67d763afb5]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:08 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 Sep 05 21:06:08 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Acquiring lock "cinder-b01a494d-da94-4f97-9a09-4f0c65fcb835-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "cinder-b01a494d-da94-4f97-9a09-4f0c65fcb835-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:08 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Acquiring lock "cinder-quobyte-b01a494d-da94-4f97-9a09-4f0c65fcb835" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78" returned: 0 in 0.521s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:06:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "cinder-quobyte-b01a494d-da94-4f97-9a09-4f0c65fcb835" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:09 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 Sep 05 21:06:09 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd9821-9b32-4f87-8ccc-6875aa224c3c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:09 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 Sep 05 21:06:09 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:09 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835" returned: 0 in 0.404s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:09 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835 Sep 05 21:06:09 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:09 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b01a494d-da94-4f97-9a09-4f0c65fcb835" returned: 0 in 0.471s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "cinder-quobyte-b01a494d-da94-4f97-9a09-4f0c65fcb835" released by "delete_volume" :: held 0.969s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:10 devstack cinder-volume[87778]: WARNING cinder.quota [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:06:10 devstack cinder-volume[87778]: WARNING cinder.quota [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Created reservations ['dd86adb1-63d4-45a4-bfad-5cf94cde3367', '88c8b41b-3939-4f34-8bfa-08b7ebcc4f4c', 'ed900477-15d2-4876-8e52-570b539e9e5f', '0bdea8d6-88ca-47d2-9228-f2429f2112c1'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:10 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:10 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:10 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.523s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:10 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Deleted volume successfully. Sep 05 21:06:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-086f2708-885a-41d4-ac5a-7710979dc954 tempest-VolumeAndVolumeTypeFromImageTest-1552925812 None] Lock "cinder-b01a494d-da94-4f97-9a09-4f0c65fcb835-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:14 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" returned: 0 in 5.702s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:14 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:06:14 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Converted 1024.00 MB image at 179.57 MB/s Sep 05 21:06:14 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 is being set with open permissions: ugo+rw Sep 05 21:06:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:14 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 Sep 05 21:06:14 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:15 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" returned: 0 in 0.398s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" released by "_copy_volume_from_snapshot" :: held 7.230s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Acquiring lock "cinder-quobyte-9453a4bc-52d1-4552-b5ff-8269e9f51c51" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-9453a4bc-52d1-4552-b5ff-8269e9f51c51" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Deleting offline snapshot 9453a4bc-52d1-4552-b5ff-8269e9f51c51 of volume 7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] snapshot_file for this snap is: volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac9e9e-bd97-445e-9500-99c2bc7a01fb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:15 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 Sep 05 21:06:15 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:15 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51" returned: 0 in 0.487s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0044c2e5-5793-4c0c-abd9-4c4b80d6904f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:15 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 Sep 05 21:06:15 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:16 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78" returned: 0 in 0.638s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:16 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 Sep 05 21:06:16 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:16 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:16 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51 Sep 05 21:06:16 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:17 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78.9453a4bc-52d1-4552-b5ff-8269e9f51c51" returned: 0 in 0.277s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-9453a4bc-52d1-4552-b5ff-8269e9f51c51" released by "_delete_snapshot" :: held 1.981s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.613s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd021556-0bb7-4e7b-93d3-e3cda75db266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84', 'volume_size': 2, 'source_volid': '7db0840d-2b72-4029-ab4f-9b9a7b762d78', 'source_volstatus': 'available'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9905d2-1689-48fb-a696-c9de0dc2345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Volume volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 (d78c890c-ff4e-4c6f-9e45-b0ef486abe84): created successfully Sep 05 21:06:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9905d2-1689-48fb-a696-c9de0dc2345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Flow 'volume_create_manager' (499307e7-595c-4c84-b1eb-93b4a9ab35e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-51414122-0f89-4ef1-9443-7c006ea8917f tempest-VolumesCloneTest-869872333 None] Created volume successfully. Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Acquiring lock "cinder-d78c890c-ff4e-4c6f-9e45-b0ef486abe84-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Lock "cinder-d78c890c-ff4e-4c6f-9e45-b0ef486abe84-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Acquiring lock "cinder-quobyte-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" acquired by "delete_volume" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1291a3-fc26-45a7-9808-8cbfa095e5f4]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (19d18133-bc60-4031-abb6-d31295a97404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0637054-d878-426e-9e79-a9e46c765db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0637054-d878-426e-9e79-a9e46c765db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-691393701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc0cbca-ebf3-4289-8f46-5a42be8677a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:19Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1c511a-9338-463d-900a-6cb943a08488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1c511a-9338-463d-900a-6cb943a08488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044cc2c2-c994-4381-91cb-70d9ae4d6950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044cc2c2-c994-4381-91cb-70d9ae4d6950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc0cbca-ebf3-4289-8f46-5a42be8677a9', 'volume_name': 'volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f588eef0-3d81-4948-8de5-20156d5e5541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f588eef0-3d81-4948-8de5-20156d5e5541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7797b159-1243-40ab-aa1d-947fbd09087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Volume 9bc0cbca-ebf3-4289-8f46-5a42be8677a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9', 'volume_size': 1} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-691393701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc0cbca-ebf3-4289-8f46-5a42be8677a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:19Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Creating volume 9bc0cbca-ebf3-4289-8f46-5a42be8677a9 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:18 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 Sep 05 21:06:18 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:19 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:19 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 1073741824 Sep 05 21:06:19 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:19 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" returned: 0 in 0.467s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:19 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84 Sep 05 21:06:19 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (c67ffb7c-20a0-4c7b-a2c7-c558580198a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb054e9-d923-4551-b9a0-49e9806f4190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb054e9-d923-4551-b9a0-49e9806f4190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1971814243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183f5b14-9b47-442a-981f-8ab9ab796f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:19Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7225ae6-99bc-4447-a80f-857ce777679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7225ae6-99bc-4447-a80f-857ce777679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9db6fb-0061-4a1d-8554-6316f81bb208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9db6fb-0061-4a1d-8554-6316f81bb208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183f5b14-9b47-442a-981f-8ab9ab796f89', 'volume_name': 'volume-183f5b14-9b47-442a-981f-8ab9ab796f89', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26afbcc-cf20-4b18-89ef-99f5dd628067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26afbcc-cf20-4b18-89ef-99f5dd628067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e43a2d3-63b6-403a-81cd-dc97938ac962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Volume 183f5b14-9b47-442a-981f-8ab9ab796f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183f5b14-9b47-442a-981f-8ab9ab796f89', 'volume_size': 1} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:19 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 1073741824" returned: 0 in 0.585s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:19 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" returned: 0 in 0.344s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:19 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 Sep 05 21:06:19 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-d78c890c-ff4e-4c6f-9e45-b0ef486abe84" released by "delete_volume" :: held 0.891s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (758ea493-a662-4f13-b492-d89a46830be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0adb963-fd19-4190-8ca3-1126552d7133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0adb963-fd19-4190-8ca3-1126552d7133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-787893095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4638a689-d9f6-4995-b5c8-d6e507fe61c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:20Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c92817-c0b4-4831-8105-82cbd3675517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c92817-c0b4-4831-8105-82cbd3675517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8ff056-67a5-4c75-9de0-c1fcb39cfa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8ff056-67a5-4c75-9de0-c1fcb39cfa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4638a689-d9f6-4995-b5c8-d6e507fe61c3', 'volume_name': 'volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e249ad-96d2-4f7b-8559-3d9d98c3b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e249ad-96d2-4f7b-8559-3d9d98c3b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afe8c6f-5ece-4f02-ba2d-c74e8a2ca742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:19 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Volume 4638a689-d9f6-4995-b5c8-d6e507fe61c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3', 'volume_size': 1} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Created reservations ['e24b597f-6672-483f-9d71-603eb579c30c', '78c70555-4673-43b9-9f51-fc7535bd07d6', 'f3c091ba-a189-4d5c-afe6-a9924eb55ae0', '556f455a-d69d-40b2-b84d-31a7893c049a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:19 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:19 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:19 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9" returned: 0 in 0.360s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1971814243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183f5b14-9b47-442a-981f-8ab9ab796f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:19Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Creating volume 183f5b14-9b47-442a-981f-8ab9ab796f89 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7797b159-1243-40ab-aa1d-947fbd09087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0937f6-1af5-4d37-a656-5cd1401bbde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 1073741824 Sep 05 21:06:20 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Volume volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 (9bc0cbca-ebf3-4289-8f46-5a42be8677a9): created successfully Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0937f6-1af5-4d37-a656-5cd1401bbde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (19d18133-bc60-4031-abb6-d31295a97404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c4b71029-b963-4510-a07d-a9309ac42d5a tempest-CreateVolumesFromImageTest-1147538736 None] Created volume successfully. Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (d0d25963-bf23-42d6-9f01-7b79b7ec3c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7e0cf9-ff4d-495a-9f26-e4a8ef99db19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7e0cf9-ff4d-495a-9f26-e4a8ef99db19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847414684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d5d00b-bb7d-4498-a2d4-e635e5c4b836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:20Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b18b771-a077-450f-8582-fee1f0f01244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b18b771-a077-450f-8582-fee1f0f01244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a11205e-81db-4deb-9eee-55da51ce62ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a11205e-81db-4deb-9eee-55da51ce62ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d5d00b-bb7d-4498-a2d4-e635e5c4b836', 'volume_name': 'volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d9e540-b989-4481-8f26-c72c17de852f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d9e540-b989-4481-8f26-c72c17de852f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9b868f-e3f4-4c7e-8c44-9563ff3cbfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Volume a9d5d00b-bb7d-4498-a2d4-e635e5c4b836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836', 'volume_size': 1} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:20 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.399s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Deleted volume successfully. Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-4073dd79-809c-45ad-965d-f386fd89f682 tempest-VolumesCloneTest-869872333 None] Lock "cinder-d78c890c-ff4e-4c6f-9e45-b0ef486abe84-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:20 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 1073741824" returned: 0 in 0.561s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:20 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 Sep 05 21:06:20 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (1888552b-74c5-4fe3-9512-83094d2889ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de3818e-1c79-4ce2-b4dc-feb062c28025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de3818e-1c79-4ce2-b4dc-feb062c28025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-74668151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f15578-bf02-4850-83fa-616c1069c1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:21Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220cd8ac-759b-43c5-9c4d-f2fe452cfc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220cd8ac-759b-43c5-9c4d-f2fe452cfc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce277d1d-bfd3-472c-9f06-7f8845312b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce277d1d-bfd3-472c-9f06-7f8845312b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f15578-bf02-4850-83fa-616c1069c1ca', 'volume_name': 'volume-e2f15578-bf02-4850-83fa-616c1069c1ca', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece47267-a86f-4851-a402-4e7c2d74f690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece47267-a86f-4851-a402-4e7c2d74f690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d083ea-e089-4f0f-95f6-bc0bff841bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Volume e2f15578-bf02-4850-83fa-616c1069c1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f15578-bf02-4850-83fa-616c1069c1ca', 'volume_size': 1} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:20 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-787893095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4638a689-d9f6-4995-b5c8-d6e507fe61c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:20Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Creating volume 4638a689-d9f6-4995-b5c8-d6e507fe61c3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e43a2d3-63b6-403a-81cd-dc97938ac962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183f5b14-9b47-442a-981f-8ab9ab796f89', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9d5b4c-3608-4f5f-be06-1204f5625905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:20 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 1073741824 Sep 05 21:06:20 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Volume volume-183f5b14-9b47-442a-981f-8ab9ab796f89 (183f5b14-9b47-442a-981f-8ab9ab796f89): created successfully Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9d5b4c-3608-4f5f-be06-1204f5625905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (c67ffb7c-20a0-4c7b-a2c7-c558580198a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d9aa3025-2a7a-4918-a376-d34b6a63223d tempest-CreateVolumesFromImageTest-1147538736 None] Created volume successfully. Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Acquiring lock "cinder-7db0840d-2b72-4029-ab4f-9b9a7b762d78-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Lock "cinder-7db0840d-2b72-4029-ab4f-9b9a7b762d78-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Acquiring lock "cinder-quobyte-7db0840d-2b72-4029-ab4f-9b9a7b762d78" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-7db0840d-2b72-4029-ab4f-9b9a7b762d78" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d85c381-7ec6-45a2-9e38-cc0f4bdbceff]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:21 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 Sep 05 21:06:21 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:21 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 1073741824" returned: 0 in 0.531s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:21 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 Sep 05 21:06:21 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:21 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:21 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78 Sep 05 21:06:21 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:21 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847414684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d5d00b-bb7d-4498-a2d4-e635e5c4b836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:20Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Creating volume a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:21 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afe8c6f-5ece-4f02-ba2d-c74e8a2ca742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:21 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 1073741824 Sep 05 21:06:21 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311c73db-be00-427f-af8b-97d337316206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:21 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Volume volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 (4638a689-d9f6-4995-b5c8-d6e507fe61c3): created successfully Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311c73db-be00-427f-af8b-97d337316206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (758ea493-a662-4f13-b492-d89a46830be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3abd5511-6ecc-493b-8adf-bbd28701ebfa tempest-CreateVolumesFromImageTest-1147538736 None] Created volume successfully. Sep 05 21:06:21 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7db0840d-2b72-4029-ab4f-9b9a7b762d78" returned: 0 in 0.287s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Lock "cinder-quobyte-7db0840d-2b72-4029-ab4f-9b9a7b762d78" released by "delete_volume" :: held 0.764s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Created reservations ['9b4c5ccb-24ec-41dc-a81f-8229f1033d97', 'f2953474-d946-4949-afdf-a85be3648b73', '53dd9b59-eae1-4bc1-bf07-ceb184feceba', 'bef7ac63-8f1e-4a74-b6df-d0992bb98765'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:22 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:22 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:22 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 1073741824" returned: 0 in 0.483s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:22 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 Sep 05 21:06:22 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:22 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.265s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Deleted volume successfully. Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e2e369f9-444c-4d84-9496-0b2da285eb9c tempest-VolumesCloneTest-869872333 None] Lock "cinder-7db0840d-2b72-4029-ab4f-9b9a7b762d78-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:22 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836" returned: 0 in 0.278s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-74668151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f15578-bf02-4850-83fa-616c1069c1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3686b9453de4b2ca1adc15469c35968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:21Z,use_quota=True,user_id='842d2c9e3dbc47a09feb7ce193ad0cca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Creating volume e2f15578-bf02-4850-83fa-616c1069c1ca {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:22 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:22 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca 1073741824 Sep 05 21:06:22 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9b868f-e3f4-4c7e-8c44-9563ff3cbfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e851fd86-b8c7-4364-b2c0-e0222d35b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:22 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Volume volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 (a9d5d00b-bb7d-4498-a2d4-e635e5c4b836): created successfully Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e851fd86-b8c7-4364-b2c0-e0222d35b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:22 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (d0d25963-bf23-42d6-9f01-7b79b7ec3c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3cf57a1c-1e39-4416-95b2-e7f330f077c3 tempest-CreateVolumesFromImageTest-1147538736 None] Created volume successfully. Sep 05 21:06:23 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca 1073741824" returned: 0 in 0.451s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:23 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca Sep 05 21:06:23 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:23 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca" returned: 0 in 0.276s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d083ea-e089-4f0f-95f6-bc0bff841bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f15578-bf02-4850-83fa-616c1069c1ca', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fec98a-6b77-4456-b5c4-b2f2ca749069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:23 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Volume volume-e2f15578-bf02-4850-83fa-616c1069c1ca (e2f15578-bf02-4850-83fa-616c1069c1ca): created successfully Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fec98a-6b77-4456-b5c4-b2f2ca749069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:23 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Flow 'volume_create_manager' (1888552b-74c5-4fe3-9512-83094d2889ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c011dd04-0dd7-4698-9abc-c0e8506f0070 tempest-CreateVolumesFromImageTest-1147538736 None] Created volume successfully. Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-e2f15578-bf02-4850-83fa-616c1069c1ca-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-e2f15578-bf02-4850-83fa-616c1069c1ca-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-quobyte-e2f15578-bf02-4850-83fa-616c1069c1ca" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-e2f15578-bf02-4850-83fa-616c1069c1ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f31eb5-f98d-491a-9eec-221025f7accc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:24 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca Sep 05 21:06:24 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:24 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:24 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca Sep 05 21:06:24 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:24 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e2f15578-bf02-4850-83fa-616c1069c1ca" returned: 0 in 0.270s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-e2f15578-bf02-4850-83fa-616c1069c1ca" released by "delete_volume" :: held 0.683s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Created reservations ['5416584b-2868-426a-949c-49844b8b62a8', 'd667a834-416a-4fc6-b45c-54096012b5e2', '6f179cc4-a2ee-49fc-8e05-59c4eaab16c0', '5392049b-c3b9-49ae-8e99-42754292e03b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:24 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:24 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:25 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Deleted volume successfully. Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e05deae-5e68-4ffc-af47-9e9d51803bd2 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-e2f15578-bf02-4850-83fa-616c1069c1ca-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-quobyte-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50059de-c1bc-4402-a999-efca2eeaa510]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:25 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 Sep 05 21:06:25 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:25 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836" returned: 0 in 0.367s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:25 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836 Sep 05 21:06:25 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:25 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836" returned: 0 in 0.277s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836" released by "delete_volume" :: held 0.682s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Created reservations ['25f969ac-6289-4972-a02b-5089c352d0ab', '13217462-2bec-4a70-87e4-a58710315585', 'a53479b1-2662-4b19-b234-372635abe95a', '64b59d55-df46-462d-b272-a79fd55343d0'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (2ba7915d-a258-4d0a-9eaa-6f1a79192126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b63db78-9ccc-44e2-a7d6-24c015b8a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b63db78-9ccc-44e2-a7d6-24c015b8a62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1405580778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56238b93-aaeb-4a52-81d9-05ed479e948a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:26Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f59831-b514-4cd9-ad5e-8bfeeca71b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43f59831-b514-4cd9-ad5e-8bfeeca71b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd21e18-909f-411b-90e2-b35c040298f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd21e18-909f-411b-90e2-b35c040298f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56238b93-aaeb-4a52-81d9-05ed479e948a', 'volume_name': 'volume-56238b93-aaeb-4a52-81d9-05ed479e948a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74eeb595-c27c-45cf-a842-c4764d622e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74eeb595-c27c-45cf-a842-c4764d622e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246f17c9-22cc-49e5-ae11-ad816ff8b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Volume 56238b93-aaeb-4a52-81d9-05ed479e948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56238b93-aaeb-4a52-81d9-05ed479e948a', 'volume_size': 1} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1405580778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56238b93-aaeb-4a52-81d9-05ed479e948a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:26Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Creating volume 56238b93-aaeb-4a52-81d9-05ed479e948a {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:26 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:26 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a 1073741824 Sep 05 21:06:26 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:26 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:26 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-4638a689-d9f6-4995-b5c8-d6e507fe61c3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-4638a689-d9f6-4995-b5c8-d6e507fe61c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-quobyte-4638a689-d9f6-4995-b5c8-d6e507fe61c3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-4638a689-d9f6-4995-b5c8-d6e507fe61c3" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:26 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.285s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Deleted volume successfully. Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea8326-7dc8-44e5-9cc9-2305e55ff74d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aef14d87-32a4-400a-96eb-4e7a8beeafee tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-a9d5d00b-bb7d-4498-a2d4-e635e5c4b836-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:26 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 Sep 05 21:06:26 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:26 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a 1073741824" returned: 0 in 0.493s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:26 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a Sep 05 21:06:26 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:26 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3" returned: 0 in 0.403s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:26 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3 Sep 05 21:06:26 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:26 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a" returned: 0 in 0.238s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246f17c9-22cc-49e5-ae11-ad816ff8b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56238b93-aaeb-4a52-81d9-05ed479e948a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e2b6a2-abcd-49b7-8f9d-0b777dd22aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:26 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Volume volume-56238b93-aaeb-4a52-81d9-05ed479e948a (56238b93-aaeb-4a52-81d9-05ed479e948a): created successfully Sep 05 21:06:26 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e2b6a2-abcd-49b7-8f9d-0b777dd22aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (2ba7915d-a258-4d0a-9eaa-6f1a79192126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-59ecc8f1-e8e0-473b-9151-4c1bc6b19e33 tempest-VolumesGetTest-1499341021 None] Created volume successfully. Sep 05 21:06:27 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4638a689-d9f6-4995-b5c8-d6e507fe61c3" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-4638a689-d9f6-4995-b5c8-d6e507fe61c3" released by "delete_volume" :: held 0.707s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Created reservations ['c509ac76-afeb-4cb6-af0e-c11c28a03197', '4355dc5c-a4c6-4c90-a36f-0f6ba15d8ad2', '61302ab7-e2d8-4529-b38e-8eda07eb1cb1', 'd6a32906-9027-43eb-9f4c-33122f30df84'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:27 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:27 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-183f5b14-9b47-442a-981f-8ab9ab796f89-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:27 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.252s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Deleted volume successfully. Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-183f5b14-9b47-442a-981f-8ab9ab796f89-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a150742-567f-4da9-9a1d-7f8fe022c3ab tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-4638a689-d9f6-4995-b5c8-d6e507fe61c3-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-quobyte-183f5b14-9b47-442a-981f-8ab9ab796f89" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-183f5b14-9b47-442a-981f-8ab9ab796f89" acquired by "delete_volume" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d416aa36-fa4d-44b6-8b09-df3ddb03320b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:27 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 Sep 05 21:06:27 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:28 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89" returned: 0 in 0.344s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:28 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89 Sep 05 21:06:28 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:28 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-183f5b14-9b47-442a-981f-8ab9ab796f89" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-183f5b14-9b47-442a-981f-8ab9ab796f89" released by "delete_volume" :: held 0.643s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Created reservations ['4ab14963-a3ff-4494-bc7c-3e9f36d43fff', 'fe3bbb09-91d9-4928-9e0f-640097ec04d1', '6e6ab3fc-9161-471b-90a3-52ad6fe8936e', '919eb21a-6753-4273-84b1-9f8beab09348'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:28 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:28 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:28 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Deleted volume successfully. Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1a1ba07-2fd8-4662-94f3-dfd0b3fcb431 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-183f5b14-9b47-442a-981f-8ab9ab796f89-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-9bc0cbca-ebf3-4289-8f46-5a42be8677a9-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-9bc0cbca-ebf3-4289-8f46-5a42be8677a9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "cinder-quobyte-9bc0cbca-ebf3-4289-8f46-5a42be8677a9" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-9bc0cbca-ebf3-4289-8f46-5a42be8677a9" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f923e0-4476-41de-9dd5-55d822b501da]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (a5f459db-23dd-4b17-b82c-fdfea6b42f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0617215e-9e39-4e77-9aba-b7e8fff61444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0617215e-9e39-4e77-9aba-b7e8fff61444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1495362121',display_name='tempest-VolumesGetTest-Volume-739470320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154ced14-e1ef-457a-bea4-de828162bcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:29Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad66abfd-b49a-4b98-b7cf-95edf3b11cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:29 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 Sep 05 21:06:29 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad66abfd-b49a-4b98-b7cf-95edf3b11cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1cf6dd-8783-41f6-a0f8-34a350772153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1cf6dd-8783-41f6-a0f8-34a350772153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154ced14-e1ef-457a-bea4-de828162bcf3', 'volume_name': 'volume-154ced14-e1ef-457a-bea4-de828162bcf3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f61f19-adea-4b6a-9e20-1c2776c58a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f61f19-adea-4b6a-9e20-1c2776c58a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa9734b-6f66-4f8e-b586-deab13135b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:29 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Volume 154ced14-e1ef-457a-bea4-de828162bcf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154ced14-e1ef-457a-bea4-de828162bcf3', 'volume_size': 1} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1495362121',display_name='tempest-VolumesGetTest-Volume-739470320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154ced14-e1ef-457a-bea4-de828162bcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:29Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Creating volume 154ced14-e1ef-457a-bea4-de828162bcf3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:29 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 1073741824 Sep 05 21:06:29 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9" returned: 0 in 0.355s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9 Sep 05 21:06:29 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 1073741824" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 Sep 05 21:06:29 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9bc0cbca-ebf3-4289-8f46-5a42be8677a9" returned: 0 in 0.273s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-quobyte-9bc0cbca-ebf3-4289-8f46-5a42be8677a9" released by "delete_volume" :: held 0.670s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Created reservations ['a7285af3-1543-4f9d-afee-cc23a75ecfb9', '422bcc4c-9c8a-4d59-a5b0-d826a22c8168', '7bb0a737-7ca0-4691-94ad-82e555af47a6', '64c9c78e-e16c-4872-bc38-fedb32fc8c30'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:29 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:29 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:29 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa9734b-6f66-4f8e-b586-deab13135b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154ced14-e1ef-457a-bea4-de828162bcf3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81af743-e4e7-4363-8627-69e35e01c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:29 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Volume volume-154ced14-e1ef-457a-bea4-de828162bcf3 (154ced14-e1ef-457a-bea4-de828162bcf3): created successfully Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81af743-e4e7-4363-8627-69e35e01c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (a5f459db-23dd-4b17-b82c-fdfea6b42f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ed0eee6b-1731-40fc-aa89-f4eab793ec2d tempest-VolumesGetTest-1499341021 None] Created volume successfully. Sep 05 21:06:29 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.271s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Deleted volume successfully. Sep 05 21:06:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6f511a7c-382f-485e-8e20-60921ff38385 tempest-CreateVolumesFromImageTest-1147538736 None] Lock "cinder-9bc0cbca-ebf3-4289-8f46-5a42be8677a9-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-154ced14-e1ef-457a-bea4-de828162bcf3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Lock "cinder-154ced14-e1ef-457a-bea4-de828162bcf3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-154ced14-e1ef-457a-bea4-de828162bcf3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-154ced14-e1ef-457a-bea4-de828162bcf3" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[61141898-88cb-438d-a8a4-d7ba0cc47e95]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 Sep 05 21:06:30 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:30 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3" returned: 0 in 0.367s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:30 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3 Sep 05 21:06:30 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:30 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-154ced14-e1ef-457a-bea4-de828162bcf3" returned: 0 in 0.274s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-154ced14-e1ef-457a-bea4-de828162bcf3" released by "delete_volume" :: held 0.681s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Created reservations ['7b75a082-802d-4289-9400-267620513699', 'a240a90e-6c93-4096-a1d1-3577b9497af9', 'fadf3450-a315-448c-91cf-702dd5e28362', 'b56d5715-9ba7-4293-bd8b-da3ce442bb2b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:31 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:31 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.274s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Deleted volume successfully. Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ab9a1e00-e0cd-429b-b1c1-9963ac8b52c1 tempest-VolumesGetTest-1499341021 None] Lock "cinder-154ced14-e1ef-457a-bea4-de828162bcf3-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-56238b93-aaeb-4a52-81d9-05ed479e948a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Lock "cinder-56238b93-aaeb-4a52-81d9-05ed479e948a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-56238b93-aaeb-4a52-81d9-05ed479e948a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-56238b93-aaeb-4a52-81d9-05ed479e948a" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c99c88-0cc2-4380-b364-a5ce1b93a2db]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a Sep 05 21:06:31 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:31 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a" returned: 0 in 0.375s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:31 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a Sep 05 21:06:31 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-56238b93-aaeb-4a52-81d9-05ed479e948a" returned: 0 in 0.243s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-56238b93-aaeb-4a52-81d9-05ed479e948a" released by "delete_volume" :: held 0.657s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Created reservations ['cb37c740-6d08-4403-bcbd-f0412f81db57', '2a37185c-0bd8-4e17-9f21-22a59da0f9c4', '35cb3c03-b7e3-4964-8505-50ace356e7b8', '86148f53-de8c-4a8e-80b1-2d72a2cd285e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:32 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:32 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:32 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.266s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Deleted volume successfully. Sep 05 21:06:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-35ae15df-c559-452a-8b21-465cc8dd52f3 tempest-VolumesGetTest-1499341021 None] Lock "cinder-56238b93-aaeb-4a52-81d9-05ed479e948a-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (5be7c794-2d7b-4f8c-a44c-b84c6d9c8ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee4a27d-fd69-4812-a86c-2d7f743d2993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee4a27d-fd69-4812-a86c-2d7f743d2993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-133198142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3724f786-c798-4f8f-8959-a85f73c23200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:33Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c48771d-fff4-45ae-8dff-f15a6d0c12f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c48771d-fff4-45ae-8dff-f15a6d0c12f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00e30af-49c2-486e-b57b-b53f8ff891b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00e30af-49c2-486e-b57b-b53f8ff891b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3724f786-c798-4f8f-8959-a85f73c23200', 'volume_name': 'volume-3724f786-c798-4f8f-8959-a85f73c23200', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317dcf14-3bc4-424f-a37b-e20fbc12f1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317dcf14-3bc4-424f-a37b-e20fbc12f1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db350ab-96c1-4c90-910b-2c156cc25bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Volume 3724f786-c798-4f8f-8959-a85f73c23200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3724f786-c798-4f8f-8959-a85f73c23200', 'volume_size': 1} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-133198142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3724f786-c798-4f8f-8959-a85f73c23200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:33Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Creating volume 3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:33 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:33 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 1073741824 Sep 05 21:06:33 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Flow 'volume_create_manager' (c75a1783-6c33-4e0b-b43a-c545f934d0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc040e5-1da2-431b-9dd7-b5138e2fc650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc040e5-1da2-431b-9dd7-b5138e2fc650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3865eb4-355d-4aa3-a49a-6512a5059a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4957db0524f34e12a2207192e748ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:33Z,use_quota=True,user_id='03241ce6821a445092e8cbf652d9278c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc834457-2165-41c9-94a9-7088685a0288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc834457-2165-41c9-94a9-7088685a0288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42f0fbb-60fc-4b5e-b443-f561ce9062d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42f0fbb-60fc-4b5e-b443-f561ce9062d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3865eb4-355d-4aa3-a49a-6512a5059a45', 'volume_name': 'volume-b3865eb4-355d-4aa3-a49a-6512a5059a45', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72223c74-7ead-407f-9734-e2eb11c76040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72223c74-7ead-407f-9734-e2eb11c76040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed3ded2-57f4-4dba-8f38-56d91531096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:33 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Volume b3865eb4-355d-4aa3-a49a-6512a5059a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3865eb4-355d-4aa3-a49a-6512a5059a45', 'volume_size': 1} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:33 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 1073741824" returned: 0 in 0.415s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:33 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 Sep 05 21:06:33 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:33 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3865eb4-355d-4aa3-a49a-6512a5059a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4957db0524f34e12a2207192e748ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:33Z,use_quota=True,user_id='03241ce6821a445092e8cbf652d9278c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Creating volume b3865eb4-355d-4aa3-a49a-6512a5059a45 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:33 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db350ab-96c1-4c90-910b-2c156cc25bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3724f786-c798-4f8f-8959-a85f73c23200', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:34 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 1073741824 Sep 05 21:06:34 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddf4637-33ca-4924-897c-65cb2d5d64f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Volume volume-3724f786-c798-4f8f-8959-a85f73c23200 (3724f786-c798-4f8f-8959-a85f73c23200): created successfully Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddf4637-33ca-4924-897c-65cb2d5d64f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (5be7c794-2d7b-4f8c-a44c-b84c6d9c8ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7848fbdf-c52f-4687-aa11-f43b343a135f tempest-VolumesGetTest-1499341021 None] Created volume successfully. Sep 05 21:06:34 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 1073741824" returned: 0 in 0.429s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:34 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 Sep 05 21:06:34 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:34 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed3ded2-57f4-4dba-8f38-56d91531096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3865eb4-355d-4aa3-a49a-6512a5059a45', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6386216-0098-433a-a8ce-7a7b9a58bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Volume volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 (b3865eb4-355d-4aa3-a49a-6512a5059a45): created successfully Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6386216-0098-433a-a8ce-7a7b9a58bf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Flow 'volume_create_manager' (c75a1783-6c33-4e0b-b43a-c545f934d0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-da402750-5bc3-4cae-a47f-a7da7c2697da tempest-CinderUnicodeTest-1694330103 None] Created volume successfully. Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (43ad15b5-2d9c-4d12-877b-7f94863a4f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64676e-0fa7-4b9d-93cb-3c049a751b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64676e-0fa7-4b9d-93cb-3c049a751b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1921095767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e8c7101-010c-44b6-b451-9edaafce884f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3724f786-c798-4f8f-8959-a85f73c23200,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:36Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b6f8dd-4754-4eca-a6a7-b1ae062c8064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b6f8dd-4754-4eca-a6a7-b1ae062c8064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ec46e8-1781-40c4-94f2-2c9af1a7d00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ec46e8-1781-40c4-94f2-2c9af1a7d00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0e8c7101-010c-44b6-b451-9edaafce884f', 'volume_name': 'volume-0e8c7101-010c-44b6-b451-9edaafce884f', 'volume_size': 1, 'source_volid': '3724f786-c798-4f8f-8959-a85f73c23200', 'source_volstatus': 'available'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740bf67b-f28a-47b4-9318-a96a116767d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740bf67b-f28a-47b4-9318-a96a116767d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450c9667-78a6-44ba-89b9-90e0469ab264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Volume 0e8c7101-010c-44b6-b451-9edaafce884f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0e8c7101-010c-44b6-b451-9edaafce884f', 'volume_size': 1, 'source_volid': '3724f786-c798-4f8f-8959-a85f73c23200', 'source_volstatus': 'available'} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Flow 'volume_create_manager' (dbf3c05b-0ad8-4591-92a9-53e7b46b1124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb4765f-6726-48fa-93ec-9ac30fe68ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:35 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Cloning volume 3724f786-c798-4f8f-8959-a85f73c23200 to volume 0e8c7101-010c-44b6-b451-9edaafce884f Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb4765f-6726-48fa-93ec-9ac30fe68ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-840570564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2f2f7c-335c-4dce-a88d-f0893ecf0dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4957db0524f34e12a2207192e748ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:36Z,use_quota=True,user_id='03241ce6821a445092e8cbf652d9278c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9002ff-96e9-4c64-8fa0-dbfe29f4d2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9002ff-96e9-4c64-8fa0-dbfe29f4d2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608ed748-b4ec-4e1f-bc85-2d7ae38aa719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608ed748-b4ec-4e1f-bc85-2d7ae38aa719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2f2f7c-335c-4dce-a88d-f0893ecf0dff', 'volume_name': 'volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45d78cb-d390-432d-bd9c-67039e576af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45d78cb-d390-432d-bd9c-67039e576af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37213585-212b-4dad-90bd-ef170d29f14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:36 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Volume 3c2f2f7c-335c-4dce-a88d-f0893ecf0dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff', 'volume_size': 1} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Creating offline snapshot 9273e5c8-c36e-45d5-93f1-ef5bfdad3839 of volume 3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbee9bb6-b38b-46a1-8e1b-66a015c76adc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:36 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 Sep 05 21:06:36 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:36 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200" returned: 0 in 0.375s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:36 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 1G Sep 05 21:06:36 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:36 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 1G" returned: 0 in 0.403s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3724f786-c798-4f8f-8959-a85f73c23200 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:36 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3724f786-c798-4f8f-8959-a85f73c23200 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 Sep 05 21:06:36 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3724f786-c798-4f8f-8959-a85f73c23200 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839" returned: 0 in 0.339s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:37 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 is being set with open permissions: ugo+rw Sep 05 21:06:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 Sep 05 21:06:37 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839" returned: 0 in 0.238s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.info Sep 05 21:06:37 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.info" returned: 0 in 0.273s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:37 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.info is being set with open permissions: ugo+rw Sep 05 21:06:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:37 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.info Sep 05 21:06:37 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:37 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.info" returned: 0 in 0.247s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-0e8c7101-010c-44b6-b451-9edaafce884f" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-0e8c7101-010c-44b6-b451-9edaafce884f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] snapshot: 9273e5c8-c36e-45d5-93f1-ef5bfdad3839, volume: 0e8c7101-010c-44b6-b451-9edaafce884f, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c35829-47dd-453e-915b-fa321d145e9a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:38 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 Sep 05 21:06:38 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:38 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839" returned: 0 in 0.397s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3724f786-c798-4f8f-8959-a85f73c23200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e699aba0-7aba-45d7-89a3-1b3ac28db81f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:38 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 Sep 05 21:06:38 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:38 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200" returned: 0 in 0.384s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:06:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:38 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f Sep 05 21:06:38 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:43 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f" returned: 0 in 4.684s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:06:43 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Converted 1024.00 MB image at 218.57 MB/s Sep 05 21:06:43 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f is being set with open permissions: ugo+rw Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:43 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f Sep 05 21:06:43 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:43 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f" returned: 0 in 0.274s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-0e8c7101-010c-44b6-b451-9edaafce884f" released by "_copy_volume_from_snapshot" :: held 5.805s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-9273e5c8-c36e-45d5-93f1-ef5bfdad3839" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-9273e5c8-c36e-45d5-93f1-ef5bfdad3839" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Deleting offline snapshot 9273e5c8-c36e-45d5-93f1-ef5bfdad3839 of volume 3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] snapshot_file for this snap is: volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f20240-3e96-4177-87ca-4ff2992624d2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 Sep 05 21:06:44 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:44 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839" returned: 0 in 0.382s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3724f786-c798-4f8f-8959-a85f73c23200(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:06:44 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f710c7d-966e-4c4a-bbd2-03acbcdafe54]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 Sep 05 21:06:44 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:44 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200" returned: 0 in 0.575s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:44 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 Sep 05 21:06:44 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:45 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839" returned: 0 in 0.365s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:45 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839 Sep 05 21:06:45 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:45 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200.9273e5c8-c36e-45d5-93f1-ef5bfdad3839" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-9273e5c8-c36e-45d5-93f1-ef5bfdad3839" released by "_delete_snapshot" :: held 1.677s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.600s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.553s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-840570564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2f2f7c-335c-4dce-a88d-f0893ecf0dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4957db0524f34e12a2207192e748ac87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:36Z,use_quota=True,user_id='03241ce6821a445092e8cbf652d9278c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Creating volume 3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:45 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450c9667-78a6-44ba-89b9-90e0469ab264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e8c7101-010c-44b6-b451-9edaafce884f', 'volume_size': 1, 'source_volid': '3724f786-c798-4f8f-8959-a85f73c23200', 'source_volstatus': 'available'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:45 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff 1073741824 Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a205bed5-8516-4b99-8523-85c699986924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:45 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:45 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Volume volume-0e8c7101-010c-44b6-b451-9edaafce884f (0e8c7101-010c-44b6-b451-9edaafce884f): created successfully Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a205bed5-8516-4b99-8523-85c699986924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (43ad15b5-2d9c-4d12-877b-7f94863a4f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-82edd1d0-7738-4549-b936-7b81d04eb692 tempest-VolumesGetTest-1499341021 None] Created volume successfully. Sep 05 21:06:46 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff 1073741824" returned: 0 in 0.467s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:46 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff Sep 05 21:06:46 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:46 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37213585-212b-4dad-90bd-ef170d29f14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441e8af6-31b0-4071-84e1-750f57e6c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Volume volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff (3c2f2f7c-335c-4dce-a88d-f0893ecf0dff): created successfully Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441e8af6-31b0-4071-84e1-750f57e6c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Flow 'volume_create_manager' (dbf3c05b-0ad8-4591-92a9-53e7b46b1124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8efae748-dd06-48a0-bd2e-71e984de7555 tempest-CinderUnicodeTest-1694330103 None] Created volume successfully. Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Creating offline snapshot ad5c7ffd-b9a7-4393-aebc-53f8c155b224 of volume 3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eb5df6-78ca-44a6-8a80-7bafae9dafcb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff Sep 05 21:06:47 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" returned: 0 in 0.461s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=185,cinder:SELECT=133,cinder:INSERT=53,cinder:DELETE=18 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:06:47 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 1G Sep 05 21:06:47 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=129,cinder:INSERT=50,cinder:UPDATE=181,cinder:DELETE=14 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (6e66fa99-e78a-467f-872b-8bd5827fef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e967506a-e024-48ec-b5b0-66215916867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e967506a-e024-48ec-b5b0-66215916867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1392104073',display_name='tempest-VolumesGetTest-Volume-495727930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49efd790-2830-4f08-bd35-adc838d1d649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:48Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42ca074-0d83-4d40-a29a-28035850ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42ca074-0d83-4d40-a29a-28035850ae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551e05b5-ae67-4d01-8ed1-77ae1d444fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551e05b5-ae67-4d01-8ed1-77ae1d444fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49efd790-2830-4f08-bd35-adc838d1d649', 'volume_name': 'volume-49efd790-2830-4f08-bd35-adc838d1d649', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b82393-93d1-4760-a116-18a3f0304939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b82393-93d1-4760-a116-18a3f0304939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11a13c1-498a-485c-a2f0-95b76783d31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Volume 49efd790-2830-4f08-bd35-adc838d1d649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49efd790-2830-4f08-bd35-adc838d1d649', 'volume_size': 1} Sep 05 21:06:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:48 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 1G" returned: 0 in 0.433s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 Sep 05 21:06:48 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:48 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224" returned: 0 in 0.319s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 is being set with open permissions: ugo+rw Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 Sep 05 21:06:48 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:48 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224" returned: 0 in 0.265s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.info Sep 05 21:06:48 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:48 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.info" returned: 0 in 0.288s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:48 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.info is being set with open permissions: ugo+rw Sep 05 21:06:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:48 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.info Sep 05 21:06:48 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:49 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.info" returned: 0 in 0.286s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.519s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1392104073',display_name='tempest-VolumesGetTest-Volume-495727930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49efd790-2830-4f08-bd35-adc838d1d649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:48Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Creating volume 49efd790-2830-4f08-bd35-adc838d1d649 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:49 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:49 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f35ff5bd-977e-433f-b806-4e72d138cb9f tempest-CinderUnicodeTest-1694330103 None] Create snapshot completed successfully Sep 05 21:06:49 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 1073741824 Sep 05 21:06:49 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:49 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 1073741824" returned: 0 in 0.468s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:49 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 Sep 05 21:06:49 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:50 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649" returned: 0 in 0.252s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11a13c1-498a-485c-a2f0-95b76783d31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49efd790-2830-4f08-bd35-adc838d1d649', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4803fd32-d992-4736-b7fd-e02e5beed996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:50 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Volume volume-49efd790-2830-4f08-bd35-adc838d1d649 (49efd790-2830-4f08-bd35-adc838d1d649): created successfully Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4803fd32-d992-4736-b7fd-e02e5beed996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (6e66fa99-e78a-467f-872b-8bd5827fef96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-024d4589-a290-4e70-953f-ad1bb5a739b2 tempest-VolumesGetTest-1499341021 None] Created volume successfully. Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "cinder-ad5c7ffd-b9a7-4393-aebc-53f8c155b224-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-ad5c7ffd-b9a7-4393-aebc-53f8c155b224-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "cinder-quobyte-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "cinder-quobyte-ad5c7ffd-b9a7-4393-aebc-53f8c155b224" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-ad5c7ffd-b9a7-4393-aebc-53f8c155b224" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Deleting offline snapshot ad5c7ffd-b9a7-4393-aebc-53f8c155b224 of volume 3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] snapshot_file for this snap is: volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0962716-fe88-4a44-ba4c-20a2ee93099c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:50 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 Sep 05 21:06:50 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:50 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224" returned: 0 in 0.405s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3e5636-295c-46c8-8b1a-83130c9e2d76]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:50 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff Sep 05 21:06:50 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-49efd790-2830-4f08-bd35-adc838d1d649-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Lock "cinder-49efd790-2830-4f08-bd35-adc838d1d649-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-49efd790-2830-4f08-bd35-adc838d1d649" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-49efd790-2830-4f08-bd35-adc838d1d649" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1102b5-226a-4ac5-89b1-a39dd77a4018]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:51 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 Sep 05 21:06:51 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" returned: 0 in 0.456s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:51 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 Sep 05 21:06:51 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649" returned: 0 in 0.397s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:51 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649 Sep 05 21:06:51 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224" returned: 0 in 0.369s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:51 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224 Sep 05 21:06:51 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-49efd790-2830-4f08-bd35-adc838d1d649" returned: 0 in 0.284s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-49efd790-2830-4f08-bd35-adc838d1d649" released by "delete_volume" :: held 0.718s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Created reservations ['bcc438cf-78c7-409f-bd2c-e3f4a4dd0378', '7aeee0da-3801-4127-a24b-9f79e531d046', 'f9d2ff63-72c6-4e6d-b5a9-3903dd09e5b0', '84bf00c5-3c98-469e-bc2a-f7166d479280'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:51 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff.ad5c7ffd-b9a7-4393-aebc-53f8c155b224" returned: 0 in 0.300s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:51 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:51 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-ad5c7ffd-b9a7-4393-aebc-53f8c155b224" released by "_delete_snapshot" :: held 1.649s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" released by "delete_snapshot" :: held 1.676s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Created reservations ['3c8b20a5-f5e9-4f0e-be7b-2814e4c7e31e', 'fb5190d3-3d74-4f98-a29d-cf326c6bbb4e', '7c0d43e8-030a-4d12-977a-7f0bf0ed37c6', 'de3fd707-05cf-4df2-abf1-62e3de562527'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Delete snapshot completed successfully. Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-43da7be7-6707-45e7-ad05-cbf3926750c9 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-ad5c7ffd-b9a7-4393-aebc-53f8c155b224-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:52 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Deleted volume successfully. Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-0e8c7101-010c-44b6-b451-9edaafce884f-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-dddacae3-f42b-4597-bb41-ddbfa46ce5b4 tempest-VolumesGetTest-1499341021 None] Lock "cinder-49efd790-2830-4f08-bd35-adc838d1d649-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Lock "cinder-0e8c7101-010c-44b6-b451-9edaafce884f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-0e8c7101-010c-44b6-b451-9edaafce884f" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-0e8c7101-010c-44b6-b451-9edaafce884f" acquired by "delete_volume" :: waited 0.013s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7784ad51-13ba-42a9-b9cb-cd7b77eab4e7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "cinder-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:52 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f Sep 05 21:06:52 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "cinder-quobyte-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d4263b-9a37-4f11-b788-5eb65c0428f3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:52 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff Sep 05 21:06:52 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:52 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:52 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f Sep 05 21:06:52 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:52 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" returned: 0 in 0.349s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:52 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff Sep 05 21:06:52 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:52 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0e8c7101-010c-44b6-b451-9edaafce884f" returned: 0 in 0.272s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-0e8c7101-010c-44b6-b451-9edaafce884f" released by "delete_volume" :: held 0.725s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Created reservations ['01eb339d-4af7-4170-ba1f-4719025c3e3f', '19463d95-4568-4976-a7e6-95bfcb788e90', '6e44779c-3cdb-42c7-a451-48e01f7761e5', '65264809-f1b9-41cc-9b61-edaa46b584b5'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:53 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:53 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:53 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" returned: 0 in 0.313s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff" released by "delete_volume" :: held 0.720s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Created reservations ['f5436091-cb07-421d-be14-e66f517e6d49', 'ece388d0-3ba3-48ee-bc31-67f52de6df4d', '5ee2831a-72eb-4663-b69a-a7baba6de68d', '1455a77e-7d8b-4529-80b0-2e1f1249ad24'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:53 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:53 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:53 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.275s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Deleted volume successfully. Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ea8cf5bd-5ec0-452a-a3d6-ce63999ac723 tempest-VolumesGetTest-1499341021 None] Lock "cinder-0e8c7101-010c-44b6-b451-9edaafce884f-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-3724f786-c798-4f8f-8959-a85f73c23200-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Lock "cinder-3724f786-c798-4f8f-8959-a85f73c23200-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-3724f786-c798-4f8f-8959-a85f73c23200" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-3724f786-c798-4f8f-8959-a85f73c23200" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed1a924-dd09-4a87-b71a-67fd082cf93f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "cinder-b3865eb4-355d-4aa3-a49a-6512a5059a45-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-b3865eb4-355d-4aa3-a49a-6512a5059a45-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:53 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.339s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "cinder-quobyte-b3865eb4-355d-4aa3-a49a-6512a5059a45" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Deleted volume successfully. Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-b3865eb4-355d-4aa3-a49a-6512a5059a45" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7db41c0e-ff32-4a71-bba0-57179035f096 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-3c2f2f7c-335c-4dce-a88d-f0893ecf0dff-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09132bd-369e-4102-944c-02352cc0ae7d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:53 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 Sep 05 21:06:53 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:53 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 Sep 05 21:06:53 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:54 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200" returned: 0 in 0.433s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:54 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200 Sep 05 21:06:54 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:54 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45" returned: 0 in 0.383s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:54 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45 Sep 05 21:06:54 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:54 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3724f786-c798-4f8f-8959-a85f73c23200" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-3724f786-c798-4f8f-8959-a85f73c23200" released by "delete_volume" :: held 0.786s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Created reservations ['0cce7cd8-d7d9-4c17-b1f2-344079eb8821', 'c6f7ee3c-9985-4ce2-bbae-c421063a4764', '5849724d-c2a3-4a02-93e8-c30ae2fb3438', 'cdce56a1-e247-4a11-80cd-892f2ca91466'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:54 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-b3865eb4-355d-4aa3-a49a-6512a5059a45" returned: 0 in 0.291s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-quobyte-b3865eb4-355d-4aa3-a49a-6512a5059a45" released by "delete_volume" :: held 0.725s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:54 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:54 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Created reservations ['d89aaae3-6bbb-44df-a5ed-e012bc28fbcc', '54a754f6-39f2-4110-b8a5-bb81b4c9c8df', 'ca529613-15b7-4595-83bb-e816295be4c5', 'b831ce1a-a90a-4002-9902-9b7db71d1a54'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:54 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:06:54 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:54 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Deleted volume successfully. Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c503d24e-dbf4-4d85-9ca1-d77eb9984e7a tempest-VolumesGetTest-1499341021 None] Lock "cinder-3724f786-c798-4f8f-8959-a85f73c23200-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:54 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.304s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:06:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Deleted volume successfully. Sep 05 21:06:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-aea22af5-32e7-4d63-ada9-554ce9eddc64 tempest-CinderUnicodeTest-1694330103 None] Lock "cinder-b3865eb4-355d-4aa3-a49a-6512a5059a45-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (ed87b4dd-faf0-4311-8a9d-4f86f97936b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149d8412-b8dd-4fe5-a4d1-84dd6d510fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149d8412-b8dd-4fe5-a4d1-84dd6d510fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2082010643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6100a24-1c82-45aa-a92d-60024ddd5a9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:55Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369eece5-9ac2-4961-8acb-a5c6f65200f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369eece5-9ac2-4961-8acb-a5c6f65200f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e30b51d-a3a2-4152-aa4d-716be0b5efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e30b51d-a3a2-4152-aa4d-716be0b5efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6100a24-1c82-45aa-a92d-60024ddd5a9d', 'volume_name': 'volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de735b40-4259-4b55-af0f-3f9514f00aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de735b40-4259-4b55-af0f-3f9514f00aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d57c61-5e53-470b-a018-f7f4937468f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:55 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Volume f6100a24-1c82-45aa-a92d-60024ddd5a9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 05 21:06:55 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Trying to clone f6100a24-1c82-45aa-a92d-60024ddd5a9d from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:06:56 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:06:56 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Image download 20.69 MB at 20.69 MB/s Sep 05 21:06:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[921295b4-6742-4cfb-a3ec-c74f7132075f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:56 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD Sep 05 21:06:56 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:56 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:56 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 is fetched for user 0dd6ec4546b4411d8874ff38c6db4a16. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:06:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7a685e-077a-485e-9de1-9f78e3b3a2e6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:56 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD Sep 05 21:06:56 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:57 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2082010643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6100a24-1c82-45aa-a92d-60024ddd5a9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:55Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Creating volume f6100a24-1c82-45aa-a92d-60024ddd5a9d {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:57 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:57 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d 1073741824 Sep 05 21:06:57 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:57 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d 1073741824" returned: 0 in 0.479s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:57 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d Sep 05 21:06:57 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:57 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d" returned: 0 in 0.261s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Attempting download of 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume f6100a24-1c82-45aa-a92d-60024ddd5a9d. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6add06a3-7ba1-4f6c-9d92-737a0b1e201b]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_z0v7qvpd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_z0v7qvpd Sep 05 21:06:58 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_z0v7qvpd" returned: 0 in 0.333s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_z0v7qvpd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_z0v7qvpd Sep 05 21:06:58 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Flow 'volume_create_manager' (12b059a8-d6ca-403d-8fec-b70a5c83d9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff19ddb-91ef-4085-b995-b044f0ee650a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff19ddb-91ef-4085-b995-b044f0ee650a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395728487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4271ba-e4f8-4bb5-bb09-706ac89b4c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88766185f364936962b627c4809315d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:58Z,use_quota=True,user_id='d954cc46dc074ca3b5b0638cd41be5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641096cb-7226-4366-b8f9-72e25fe50488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641096cb-7226-4366-b8f9-72e25fe50488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d18093-0e6a-49ff-970c-f475849719af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d18093-0e6a-49ff-970c-f475849719af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4271ba-e4f8-4bb5-bb09-706ac89b4c39', 'volume_name': 'volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca083f82-7934-428a-9408-c57d66125001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca083f82-7934-428a-9408-c57d66125001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e302046-df35-4ce7-82ea-c346621fdcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:58 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Volume fe4271ba-e4f8-4bb5-bb09-706ac89b4c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39', 'volume_size': 1} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395728487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4271ba-e4f8-4bb5-bb09-706ac89b4c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88766185f364936962b627c4809315d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:06:58Z,use_quota=True,user_id='d954cc46dc074ca3b5b0638cd41be5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Creating volume fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:06:58 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 1073741824 Sep 05 21:06:58 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_z0v7qvpd" returned: 1 in 0.334s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1e185b14-4f13-44ff-ab1c-d13d5db83085_z0v7qvpd' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[86adc990-b576-49ca-860f-2436a32cc8b8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD Sep 05 21:06:58 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:58 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 1073741824" returned: 0 in 0.430s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] 1e185b14-4f13-44ff-ab1c-d13d5db83085 was qcow2, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:58 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d Sep 05 21:06:58 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:59 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 Sep 05 21:06:59 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:06:59 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e302046-df35-4ce7-82ea-c346621fdcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879fab2d-c694-4ad3-a441-375a7b5efe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:06:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Volume volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 (fe4271ba-e4f8-4bb5-bb09-706ac89b4c39): created successfully Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879fab2d-c694-4ad3-a441-375a7b5efe76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Flow 'volume_create_manager' (12b059a8-d6ca-403d-8fec-b70a5c83d9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:06:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-398620c0-5edc-4314-8721-f56d57177e99 tempest-ProjectReaderTests-1110238346 None] Created volume successfully. Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "cinder-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "cinder-quobyte-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-quobyte-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f13c6b2-86ea-4709-bbd8-62ed80bc4544]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:06:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:06:59 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 Sep 05 21:06:59 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39" returned: 0 in 0.411s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39 Sep 05 21:07:00 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-quobyte-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39" released by "delete_volume" :: held 0.706s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Created reservations ['8725ec3e-ae29-4407-b7fa-9fbfafe4828d', 'e8ac8849-82c2-44b5-a951-81eca7a4679f', '39b9e7f0-8379-4e82-9285-cd61c1717517', 'e758316a-ea34-4e94-bac8-cfb65f4c6105'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:00 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d" returned: 0 in 1.677s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1e185b14-4f13-44ff-ab1c-d13d5db83085_i4vqy7oydevstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:07:00 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Converted 112.00 MB image at 66.75 MB/s Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:00 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d 1G Sep 05 21:07:00 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:00 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.276s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:00 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Deleted volume successfully. Sep 05 21:07:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e54119ea-867c-4530-bfd2-2db88a37a353 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-fe4271ba-e4f8-4bb5-bb09-706ac89b4c39-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:01 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d 1G" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Downloaded image 1e185b14-4f13-44ff-ab1c-d13d5db83085 ((None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}])) to volume f6100a24-1c82-45aa-a92d-60024ddd5a9d successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Temporary image 1e185b14-4f13-44ff-ab1c-d13d5db83085 for user 0dd6ec4546b4411d8874ff38c6db4a16 is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Marking volume f6100a24-1c82-45aa-a92d-60024ddd5a9d as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Copying metadata from image 1e185b14-4f13-44ff-ab1c-d13d5db83085 to f6100a24-1c82-45aa-a92d-60024ddd5a9d. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Creating volume glance metadata for volume f6100a24-1c82-45aa-a92d-60024ddd5a9d backed by image 1e185b14-4f13-44ff-ab1c-d13d5db83085 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d57c61-5e53-470b-a018-f7f4937468f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d', 'volume_size': 1, 'image_id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1e185b14-4f13-44ff-ab1c-d13d5db83085', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'af6c1b00e2ff456683cf3379f3195cdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1e185b14-4f13-44ff-ab1c-d13d5db83085', 'created_at': datetime.datetime(2026, 9, 5, 18, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 18, 42, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1e185b14-4f13-44ff-ab1c-d13d5db83085/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9b8a1-09a9-4593-90dc-68af7974a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:01 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Volume volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d (f6100a24-1c82-45aa-a92d-60024ddd5a9d): created successfully Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc9b8a1-09a9-4593-90dc-68af7974a984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (ed87b4dd-faf0-4311-8a9d-4f86f97936b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bbe55f67-8434-4efb-9dff-c3cf9747fb3a tempest-VolumesGetTest-1499341021 None] Created volume successfully. Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Flow 'volume_create_manager' (a700fd94-0a62-4e6c-a836-43daee48ab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4574c1c-ccf8-4af8-b1ba-8f2d0fbe3e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4574c1c-ccf8-4af8-b1ba-8f2d0fbe3e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183472027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8252fb0-7ed4-4143-9d09-61ff4040858f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88766185f364936962b627c4809315d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:01Z,use_quota=True,user_id='d954cc46dc074ca3b5b0638cd41be5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a157a7a3-7ac8-4844-924e-d6b3f8e04f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a157a7a3-7ac8-4844-924e-d6b3f8e04f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca092bae-31fd-4451-a71e-2f007644dc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca092bae-31fd-4451-a71e-2f007644dc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8252fb0-7ed4-4143-9d09-61ff4040858f', 'volume_name': 'volume-c8252fb0-7ed4-4143-9d09-61ff4040858f', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23aa7ef6-3ff5-47b1-8ba6-12b4dce7d762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23aa7ef6-3ff5-47b1-8ba6-12b4dce7d762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39924ced-0fdb-4f69-b993-123e13d86f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:01 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Volume c8252fb0-7ed4-4143-9d09-61ff4040858f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8252fb0-7ed4-4143-9d09-61ff4040858f', 'volume_size': 1} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183472027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8252fb0-7ed4-4143-9d09-61ff4040858f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e88766185f364936962b627c4809315d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:01Z,use_quota=True,user_id='d954cc46dc074ca3b5b0638cd41be5a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Creating volume c8252fb0-7ed4-4143-9d09-61ff4040858f {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:01 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f 1073741824 Sep 05 21:07:01 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:01 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f 1073741824" returned: 0 in 0.433s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:01 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f Sep 05 21:07:01 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39924ced-0fdb-4f69-b993-123e13d86f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8252fb0-7ed4-4143-9d09-61ff4040858f', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7945e010-27c1-4732-8cd9-e6d4c9987596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Volume volume-c8252fb0-7ed4-4143-9d09-61ff4040858f (c8252fb0-7ed4-4143-9d09-61ff4040858f): created successfully Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7945e010-27c1-4732-8cd9-e6d4c9987596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Flow 'volume_create_manager' (a700fd94-0a62-4e6c-a836-43daee48ab9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-67bd91ff-e3be-4091-ab2a-b0a2bc6c7ec4 tempest-ProjectReaderTests-1110238346 None] Created volume successfully. Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "cinder-c8252fb0-7ed4-4143-9d09-61ff4040858f-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-c8252fb0-7ed4-4143-9d09-61ff4040858f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "cinder-quobyte-c8252fb0-7ed4-4143-9d09-61ff4040858f" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-quobyte-c8252fb0-7ed4-4143-9d09-61ff4040858f" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b7921-ad50-457a-8eac-86ae257a34e3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f Sep 05 21:07:02 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (169accd1-0181-42f9-9170-ad5685fe51b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d91e8d-9c66-4537-9b85-fcd3c8c35b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d91e8d-9c66-4537-9b85-fcd3c8c35b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1986898679',display_name='tempest-VolumesGetTest-Volume-111161480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97841252-510c-4ff1-9edb-1d9b6d3c7166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:03Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cf2096-0135-47b8-9b0b-4e3828f5ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cf2096-0135-47b8-9b0b-4e3828f5ca29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc445b46-7ae7-4a0d-97a1-f07b6378deb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc445b46-7ae7-4a0d-97a1-f07b6378deb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97841252-510c-4ff1-9edb-1d9b6d3c7166', 'volume_name': 'volume-97841252-510c-4ff1-9edb-1d9b6d3c7166', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed390856-d46e-4ba4-8791-0bfae03c4124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed390856-d46e-4ba4-8791-0bfae03c4124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621ef8ff-7cab-4459-8453-11c262a32ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Volume 97841252-510c-4ff1-9edb-1d9b6d3c7166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97841252-510c-4ff1-9edb-1d9b6d3c7166', 'volume_size': 1} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1986898679',display_name='tempest-VolumesGetTest-Volume-111161480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97841252-510c-4ff1-9edb-1d9b6d3c7166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c156417b1a4c278643116efd47697f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:03Z,use_quota=True,user_id='0dd6ec4546b4411d8874ff38c6db4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Creating volume 97841252-510c-4ff1-9edb-1d9b6d3c7166 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:02 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 1073741824 Sep 05 21:07:02 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:02 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f" returned: 0 in 0.385s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:02 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f Sep 05 21:07:02 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c8252fb0-7ed4-4143-9d09-61ff4040858f" returned: 0 in 0.285s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-quobyte-c8252fb0-7ed4-4143-9d09-61ff4040858f" released by "delete_volume" :: held 0.728s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:03 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Created reservations ['46489604-3674-4adc-8046-99886d272115', '2cfe16a7-66c4-4158-a83c-6eaf731a79cf', '41fe43e3-59a6-466f-9c93-26ca303099f2', '09b5f8fe-47a4-47b6-a0ca-781e6f95399a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 1073741824" returned: 0 in 0.425s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:03 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 Sep 05 21:07:03 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:03 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:03 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:03 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166" returned: 0 in 0.279s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621ef8ff-7cab-4459-8453-11c262a32ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97841252-510c-4ff1-9edb-1d9b6d3c7166', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c889c2a9-97f3-4e04-97c2-c1229bda5a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:03 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.286s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Volume volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 (97841252-510c-4ff1-9edb-1d9b6d3c7166): created successfully Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c889c2a9-97f3-4e04-97c2-c1229bda5a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Flow 'volume_create_manager' (169accd1-0181-42f9-9170-ad5685fe51b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Deleted volume successfully. Sep 05 21:07:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0412d079-c93b-4033-b812-2525a0d5f889 tempest-VolumesGetTest-1499341021 None] Created volume successfully. Sep 05 21:07:03 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8084674c-6a1f-407b-9d87-0fac8eceb0c8 tempest-ProjectReaderTests-1110238346 None] Lock "cinder-c8252fb0-7ed4-4143-9d09-61ff4040858f-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-97841252-510c-4ff1-9edb-1d9b6d3c7166-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Lock "cinder-97841252-510c-4ff1-9edb-1d9b6d3c7166-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:04 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:04 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-97841252-510c-4ff1-9edb-1d9b6d3c7166" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-97841252-510c-4ff1-9edb-1d9b6d3c7166" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc28d5-7ac2-48d3-b7bd-3826ddeaa5ba]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:05 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 Sep 05 21:07:05 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:05 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.337s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:07:05 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166" returned: 0 in 0.379s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:05 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166 Sep 05 21:07:05 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:05 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-97841252-510c-4ff1-9edb-1d9b6d3c7166" returned: 0 in 0.277s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-97841252-510c-4ff1-9edb-1d9b6d3c7166" released by "delete_volume" :: held 0.706s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Created reservations ['9bb58cd1-9cc9-4db2-a466-f8f7953e497d', 'eefb3e44-c3bc-4d18-8c52-7fff9d0aa229', 'b924f24c-2c97-4da1-b3b8-b83fa9a21ae5', 'ea66007b-a628-4cb1-93ea-86d2349016b4'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:05 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:05 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-f6100a24-1c82-45aa-a92d-60024ddd5a9d-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Lock "cinder-f6100a24-1c82-45aa-a92d-60024ddd5a9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.304s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Deleted volume successfully. Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Acquiring lock "cinder-quobyte-f6100a24-1c82-45aa-a92d-60024ddd5a9d" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ceef2909-6e88-4b15-bd82-83a7155fd308 tempest-VolumesGetTest-1499341021 None] Lock "cinder-97841252-510c-4ff1-9edb-1d9b6d3c7166-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-f6100a24-1c82-45aa-a92d-60024ddd5a9d" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9330fd8c-13c4-4d4d-9e93-618d6404d7cf]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d Sep 05 21:07:06 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d" returned: 0 in 0.415s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:06 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d Sep 05 21:07:06 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:06 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f6100a24-1c82-45aa-a92d-60024ddd5a9d" returned: 0 in 0.280s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Lock "cinder-quobyte-f6100a24-1c82-45aa-a92d-60024ddd5a9d" released by "delete_volume" :: held 0.734s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Created reservations ['ff6a79db-8e12-4c1a-a03e-48d9588d32d3', '9a9abaa1-5282-45ac-bbfe-ab215d768db8', '78ec04e4-6b77-41d9-abc3-5d13eabfad01', '5c267b87-3bc3-456d-a4de-c141436cd0e4'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:07 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:07 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:07 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Deleted volume successfully. Sep 05 21:07:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-555e6a72-64c1-4ef3-a852-e7087ba9a6d0 tempest-VolumesGetTest-1499341021 None] Lock "cinder-f6100a24-1c82-45aa-a92d-60024ddd5a9d-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:17 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=66,cinder:DELETE=11,cinder:UPDATE=104,cinder:INSERT=31 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:07:17 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=74,cinder:UPDATE=85,cinder:INSERT=28,cinder:DELETE=4 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (bf55478d-d0fb-4f65-a310-31776e8a6deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36066cd8-5553-405c-a859-66ac57e5debc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36066cd8-5553-405c-a859-66ac57e5debc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-226443007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828322d0-8b68-4f2f-a874-f67eb1b99aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:20Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fe0d1c-56f5-4172-a089-30814edf62fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fe0d1c-56f5-4172-a089-30814edf62fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02ff98d-9bc0-4d7f-ae3d-af6fcc4a3ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02ff98d-9bc0-4d7f-ae3d-af6fcc4a3ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828322d0-8b68-4f2f-a874-f67eb1b99aa8', 'volume_name': 'volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedba747-0452-4859-80b3-4137da3eeb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedba747-0452-4859-80b3-4137da3eeb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e57d492-852e-42f2-a906-a11426e11ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume 828322d0-8b68-4f2f-a874-f67eb1b99aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8', 'volume_size': 1} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-226443007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828322d0-8b68-4f2f-a874-f67eb1b99aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:20Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating volume 828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:20 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:20 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 1073741824 Sep 05 21:07:20 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:20 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 1073741824" returned: 0 in 0.486s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:20 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 Sep 05 21:07:20 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:21 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8" returned: 0 in 0.257s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:21 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e57d492-852e-42f2-a906-a11426e11ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6ef895-8e58-43d8-8a4d-e0912fd4a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:21 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 (828322d0-8b68-4f2f-a874-f67eb1b99aa8): created successfully Sep 05 21:07:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6ef895-8e58-43d8-8a4d-e0912fd4a376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:21 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (bf55478d-d0fb-4f65-a310-31776e8a6deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8d7f148e-cb29-483f-b5a5-976e80426fc4 tempest-VolumesSnapshotTestJSON-1829696413 None] Created volume successfully. Sep 05 21:07:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating offline snapshot 5b1ade3d-ba75-4f9b-b590-115d161b5810 of volume 828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:22 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5a5127-80d1-430d-8a17-8709543569cd]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:22 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 Sep 05 21:07:22 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:23 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8" returned: 0 in 0.405s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:23 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 1G Sep 05 21:07:23 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:23 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 1G" returned: 0 in 0.460s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:23 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 Sep 05 21:07:23 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:23 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810" returned: 0 in 0.298s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:23 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 is being set with open permissions: ugo+rw Sep 05 21:07:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:23 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 Sep 05 21:07:23 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:24 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:24 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.info Sep 05 21:07:24 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:24 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.info" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:24 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.info is being set with open permissions: ugo+rw Sep 05 21:07:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:24 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.info Sep 05 21:07:24 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:24 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.info" returned: 0 in 0.266s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d00b2a59-489c-408e-bd9c-18a11fb5dec9 tempest-VolumesSnapshotTestJSON-1829696413 None] Create snapshot completed successfully Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-5b1ade3d-ba75-4f9b-b590-115d161b5810-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-5b1ade3d-ba75-4f9b-b590-115d161b5810-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-828322d0-8b68-4f2f-a874-f67eb1b99aa8" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-828322d0-8b68-4f2f-a874-f67eb1b99aa8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-5b1ade3d-ba75-4f9b-b590-115d161b5810" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-5b1ade3d-ba75-4f9b-b590-115d161b5810" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Deleting offline snapshot 5b1ade3d-ba75-4f9b-b590-115d161b5810 of volume 828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] snapshot_file for this snap is: volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f252d4-1a76-4de5-88c4-c57441d9c15e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:26 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 Sep 05 21:07:26 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:26 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810" returned: 0 in 0.340s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cef6887-f014-4559-aafb-f739a71c78b8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:26 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 Sep 05 21:07:26 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:26 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8" returned: 0 in 0.420s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:26 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 Sep 05 21:07:26 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:27 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:27 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810 Sep 05 21:07:27 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:27 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8.5b1ade3d-ba75-4f9b-b590-115d161b5810" returned: 0 in 0.285s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-5b1ade3d-ba75-4f9b-b590-115d161b5810" released by "_delete_snapshot" :: held 1.582s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-828322d0-8b68-4f2f-a874-f67eb1b99aa8" released by "delete_snapshot" :: held 1.612s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:27 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['94238e48-7eff-4fb1-b783-1206aebb8e6f', '81195275-50d2-4fee-b00c-c60ba5aad955', '17a0f894-9ab8-4af7-a03b-1fc4a2481e37', '186705d7-855f-4d52-b342-733a88ae9d0c'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Delete snapshot completed successfully. Sep 05 21:07:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a5d1b422-dd6d-47a6-bb39-0b5d76882006 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-5b1ade3d-ba75-4f9b-b590-115d161b5810-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (6b5a007f-77ef-422e-ad2c-46c1888e6aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c49a9c7-bbca-45e5-8bcb-33d607091e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c49a9c7-bbca-45e5-8bcb-33d607091e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-579187175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd77079f-b1e4-4385-9b6f-67229cf146fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:29Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c137aa-fee1-4f04-8eed-393ed1ded20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c137aa-fee1-4f04-8eed-393ed1ded20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec8346a-4101-4f3b-a263-3cb6a9f667ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec8346a-4101-4f3b-a263-3cb6a9f667ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd77079f-b1e4-4385-9b6f-67229cf146fe', 'volume_name': 'volume-dd77079f-b1e4-4385-9b6f-67229cf146fe', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9cca74-9a71-48fb-bbb9-250258d068d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9cca74-9a71-48fb-bbb9-250258d068d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fe6bc7-b6af-4478-9934-42d6e17e3386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:28 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Volume dd77079f-b1e4-4385-9b6f-67229cf146fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd77079f-b1e4-4385-9b6f-67229cf146fe', 'volume_size': 1} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-579187175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd77079f-b1e4-4385-9b6f-67229cf146fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:29Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Creating volume dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:28 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:07:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:28 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe 1073741824 Sep 05 21:07:28 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:29 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe 1073741824" returned: 0 in 0.501s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:29 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe Sep 05 21:07:29 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:29 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe" returned: 0 in 0.302s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0fe6bc7-b6af-4478-9934-42d6e17e3386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd77079f-b1e4-4385-9b6f-67229cf146fe', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfca00c-4d14-4758-80b2-138451318203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:29 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Volume volume-dd77079f-b1e4-4385-9b6f-67229cf146fe (dd77079f-b1e4-4385-9b6f-67229cf146fe): created successfully Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfca00c-4d14-4758-80b2-138451318203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:29 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (6b5a007f-77ef-422e-ad2c-46c1888e6aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6905fe17-d78a-4669-9d3a-45aec2e10c3a tempest-VolumesSnapshotTestJSON-1829696413 None] Created volume successfully. Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Flow 'volume_create_manager' (52147901-1aa1-4f01-b840-5b3011efa745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb8127f-c545-4bf4-ab3a-1a9d3e5ec0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb8127f-c545-4bf4-ab3a-1a9d3e5ec0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-510049009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8a2e27-99c7-4827-b45f-f8122a865dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9efde7e58f64295b8958669f658096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:31Z,use_quota=True,user_id='3cc7a90e6cbd4268ae06d3cb5eaed359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c507a4b5-9dd8-415a-8fb0-0c7298218f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c507a4b5-9dd8-415a-8fb0-0c7298218f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf47e526-d304-49d4-b5e9-1d1e9cbcaf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf47e526-d304-49d4-b5e9-1d1e9cbcaf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8a2e27-99c7-4827-b45f-f8122a865dc3', 'volume_name': 'volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ded0492-7a43-41e7-a2e6-1c310cc53684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ded0492-7a43-41e7-a2e6-1c310cc53684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcbeb0d-5b8a-4196-a5db-eeec082d741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:30 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Volume 1f8a2e27-99c7-4827-b45f-f8122a865dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3', 'volume_size': 1} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-510049009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8a2e27-99c7-4827-b45f-f8122a865dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9efde7e58f64295b8958669f658096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:31Z,use_quota=True,user_id='3cc7a90e6cbd4268ae06d3cb5eaed359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Creating volume 1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:30 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:07:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:30 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 1073741824 Sep 05 21:07:30 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:31 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 1073741824" returned: 0 in 0.429s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:31 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 Sep 05 21:07:31 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:31 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3" returned: 0 in 0.233s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.386s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcbeb0d-5b8a-4196-a5db-eeec082d741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bce9d9-4f80-417a-89b4-fc3f37495a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating offline snapshot 995b9b2d-2ca6-4f67-9677-621748c915bb of volume dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:31 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Volume volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 (1f8a2e27-99c7-4827-b45f-f8122a865dc3): created successfully Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31bce9d9-4f80-417a-89b4-fc3f37495a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Flow 'volume_create_manager' (52147901-1aa1-4f01-b840-5b3011efa745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41041e9-170a-4ccb-bcc6-8ec9e00ed451]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6c1e402d-04f1-4f23-a65f-60a25e4e1abb tempest-SnapshotDependencyTests-1100823082 None] Created volume successfully. Sep 05 21:07:31 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe Sep 05 21:07:31 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:31 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe" returned: 0 in 0.369s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:31 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb 1G Sep 05 21:07:31 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:32 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb 1G" returned: 0 in 0.392s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd77079f-b1e4-4385-9b6f-67229cf146fe -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:32 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd77079f-b1e4-4385-9b6f-67229cf146fe -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb Sep 05 21:07:32 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:32 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd77079f-b1e4-4385-9b6f-67229cf146fe -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb" returned: 0 in 0.286s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:32 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb is being set with open permissions: ugo+rw Sep 05 21:07:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:32 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb Sep 05 21:07:32 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:32 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:32 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.info Sep 05 21:07:32 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.info" returned: 0 in 0.239s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:33 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.info is being set with open permissions: ugo+rw Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.info Sep 05 21:07:33 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.info" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.411s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Creating offline snapshot 03beef24-005c-490b-ac51-48874bb1819b of volume 1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7982cb09-18f3-45d8-859c-25c9b7da0f1f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-028f57cf-15b3-4163-8701-2c7ac3d71837 tempest-VolumesSnapshotTestJSON-1829696413 None] Create snapshot completed successfully Sep 05 21:07:33 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 Sep 05 21:07:33 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:33 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3" returned: 0 in 0.348s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:33 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b 1G Sep 05 21:07:33 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b 1G" returned: 0 in 0.385s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:34 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b Sep 05 21:07:34 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b" returned: 0 in 0.287s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:34 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b is being set with open permissions: ugo+rw Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:34 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b Sep 05 21:07:34 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:34 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.info Sep 05 21:07:34 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (3a1a492d-24b3-441f-9d2f-01390b53d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f849c04c-0e47-4bd4-8cf9-71cb357e7fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f849c04c-0e47-4bd4-8cf9-71cb357e7fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1123575479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9004fb6-9d44-4cd8-8aaf-46486516e6e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=995b9b2d-2ca6-4f67-9677-621748c915bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:35Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa658d1-3db1-4ed5-bcd4-45ea59cae0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa658d1-3db1-4ed5-bcd4-45ea59cae0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da24d84-7e8e-4d3d-bc00-688d9cfe7ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da24d84-7e8e-4d3d-bc00-688d9cfe7ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9004fb6-9d44-4cd8-8aaf-46486516e6e0', 'volume_name': 'volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0', 'volume_size': 2, 'snapshot_id': '995b9b2d-2ca6-4f67-9677-621748c915bb'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15032f69-ca75-4421-91bf-54d36436df65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15032f69-ca75-4421-91bf-54d36436df65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8516e9c-2f8a-45c1-838b-7db5f9108387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:34 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume c9004fb6-9d44-4cd8-8aaf-46486516e6e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0', 'volume_size': 2, 'snapshot_id': '995b9b2d-2ca6-4f67-9677-621748c915bb'} Sep 05 21:07:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:35 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.info" returned: 0 in 0.261s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:35 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.info is being set with open permissions: ugo+rw Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:35 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.info Sep 05 21:07:35 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:35 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.info" returned: 0 in 0.267s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.391s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-995b9b2d-2ca6-4f67-9677-621748c915bb-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-995b9b2d-2ca6-4f67-9677-621748c915bb-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating volume c9004fb6-9d44-4cd8-8aaf-46486516e6e0 from snapshot 995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:35 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-861d71e9-badc-4bb4-b1e9-5fc0ea746275 tempest-SnapshotDependencyTests-1100823082 None] Create snapshot completed successfully Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] snapshot: 995b9b2d-2ca6-4f67-9677-621748c915bb, volume: c9004fb6-9d44-4cd8-8aaf-46486516e6e0, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[197490f5-dee0-408f-ba78-c74580d7c3cb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:35 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb Sep 05 21:07:35 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:35 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb" returned: 0 in 0.387s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd77079f-b1e4-4385-9b6f-67229cf146fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecfe94c-dc19-4419-b687-148b2cad816c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:35 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe Sep 05 21:07:35 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:36 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:07:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:07:36 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:07:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:36 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 Sep 05 21:07:36 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:36 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Flow 'volume_create_manager' (2a2bc006-e849-424c-b214-ea492a027617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc929cc-f4ef-4439-ab93-377200c7d1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc929cc-f4ef-4439-ab93-377200c7d1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d49a9a-73a6-44de-ac5c-959688ac9a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9efde7e58f64295b8958669f658096b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03beef24-005c-490b-ac51-48874bb1819b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:37Z,use_quota=True,user_id='3cc7a90e6cbd4268ae06d3cb5eaed359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9876e99-f6d2-43a9-90c7-59a43adaced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9876e99-f6d2-43a9-90c7-59a43adaced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3dc01b-92b7-4132-bc24-6d3e7a03e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3dc01b-92b7-4132-bc24-6d3e7a03e895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38d49a9a-73a6-44de-ac5c-959688ac9a2a', 'volume_name': 'volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a', 'volume_size': 1, 'snapshot_id': '03beef24-005c-490b-ac51-48874bb1819b'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee9caa1-92e0-4a84-b405-b5f555af9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee9caa1-92e0-4a84-b405-b5f555af9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe572ef-ab5f-4e32-ba55-8151324c6a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:37 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Volume 38d49a9a-73a6-44de-ac5c-959688ac9a2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a', 'volume_size': 1, 'snapshot_id': '03beef24-005c-490b-ac51-48874bb1819b'} Sep 05 21:07:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:40 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" returned: 0 in 4.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe, size 1024.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:07:40 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Converted 1024.00 MB image at 240.10 MB/s Sep 05 21:07:40 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 is being set with open permissions: ugo+rw Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:40 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 Sep 05 21:07:40 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:40 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" returned: 0 in 0.241s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" released by "_copy_volume_from_snapshot" :: held 5.370s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-995b9b2d-2ca6-4f67-9677-621748c915bb-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" released by "_create_volume_from_snapshot" :: held 5.430s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.455s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.479s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-quobyte-03beef24-005c-490b-ac51-48874bb1819b-38d49a9a-73a6-44de-ac5c-959688ac9a2a" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-03beef24-005c-490b-ac51-48874bb1819b-38d49a9a-73a6-44de-ac5c-959688ac9a2a" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Creating volume 38d49a9a-73a6-44de-ac5c-959688ac9a2a from snapshot 03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-quobyte-38d49a9a-73a6-44de-ac5c-959688ac9a2a" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8516e9c-2f8a-45c1-838b-7db5f9108387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0', 'volume_size': 2, 'snapshot_id': '995b9b2d-2ca6-4f67-9677-621748c915bb'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc6bd1a-51b2-4fa3-98f2-ca49677d7d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 (c9004fb6-9d44-4cd8-8aaf-46486516e6e0): created successfully Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc6bd1a-51b2-4fa3-98f2-ca49677d7d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (3a1a492d-24b3-441f-9d2f-01390b53d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-38d49a9a-73a6-44de-ac5c-959688ac9a2a" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] snapshot: 03beef24-005c-490b-ac51-48874bb1819b, volume: 38d49a9a-73a6-44de-ac5c-959688ac9a2a, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9be0bab6-494a-40e6-b114-8901ac391354 tempest-VolumesSnapshotTestJSON-1829696413 None] Created volume successfully. Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdc9337-bda1-458d-89a9-605e96b220ad]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:41 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b Sep 05 21:07:41 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b" returned: 0 in 0.388s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb62dc9-3af1-403e-b986-9c06549a016b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:41 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 Sep 05 21:07:41 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-c9004fb6-9d44-4cd8-8aaf-46486516e6e0-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-c9004fb6-9d44-4cd8-8aaf-46486516e6e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[675bb667-73ac-4b4d-9005-6620470fd3de]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:41 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 Sep 05 21:07:41 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3" returned: 0 in 0.430s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:41 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a Sep 05 21:07:41 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:41 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" returned: 0 in 0.382s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:42 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0 Sep 05 21:07:42 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:42 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-c9004fb6-9d44-4cd8-8aaf-46486516e6e0" released by "delete_volume" :: held 0.696s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['c0d5d00e-5b32-4418-aea9-178c7b67fb3e', '0bc378e6-2712-4404-b69b-f5a834abc86e', '9ed57d9d-0c7a-4a64-a9aa-631a6dd97a9f', '52a362ca-41a9-46d6-a06e-48872245f1f3'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:42 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:42 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-995b9b2d-2ca6-4f67-9677-621748c915bb-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-995b9b2d-2ca6-4f67-9677-621748c915bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-dd77079f-b1e4-4385-9b6f-67229cf146fe" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-dd77079f-b1e4-4385-9b6f-67229cf146fe" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-995b9b2d-2ca6-4f67-9677-621748c915bb" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-995b9b2d-2ca6-4f67-9677-621748c915bb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Deleting offline snapshot 995b9b2d-2ca6-4f67-9677-621748c915bb of volume dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] snapshot_file for this snap is: volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a21bfa-bd29-421c-b8c6-fada55a03468]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:43 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.700s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Deleted volume successfully. Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fa781385-1037-451a-8e06-1e1695ef374e tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-c9004fb6-9d44-4cd8-8aaf-46486516e6e0-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:43 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb Sep 05 21:07:43 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:43 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb" returned: 0 in 0.599s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd77079f-b1e4-4385-9b6f-67229cf146fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9d8444-835e-4ee4-b0cb-d1e70d879747]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:44 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe Sep 05 21:07:44 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:44 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe" returned: 0 in 1.023s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:44 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb Sep 05 21:07:44 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:45 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb" returned: 0 in 0.650s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:45 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb Sep 05 21:07:45 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:46 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe.995b9b2d-2ca6-4f67-9677-621748c915bb" returned: 0 in 0.542s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-995b9b2d-2ca6-4f67-9677-621748c915bb" released by "_delete_snapshot" :: held 3.021s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-dd77079f-b1e4-4385-9b6f-67229cf146fe" released by "delete_snapshot" :: held 3.079s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['94c60a8d-3f30-407d-99a6-8fa76b0913af', '6967ad93-9bc6-4dd6-be02-d1f8e263dd81', '9486542a-0157-4cb9-8ee6-0810b19b726a', '41cce72a-ceec-40fb-bc15-1ed346d89572'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Delete snapshot completed successfully. Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e5b0775e-4900-4780-a398-a7e2431e41a2 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-995b9b2d-2ca6-4f67-9677-621748c915bb-delete_snapshot" released by "delete_snapshot" :: held 3.426s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:46 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a" returned: 0 in 4.864s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:07:46 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Converted 1024.00 MB image at 210.47 MB/s Sep 05 21:07:46 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a is being set with open permissions: ugo+rw Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:46 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a Sep 05 21:07:46 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:46 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-38d49a9a-73a6-44de-ac5c-959688ac9a2a" released by "_copy_volume_from_snapshot" :: held 6.027s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-03beef24-005c-490b-ac51-48874bb1819b-38d49a9a-73a6-44de-ac5c-959688ac9a2a" released by "_create_volume_from_snapshot" :: held 6.114s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.142s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe572ef-ab5f-4e32-ba55-8151324c6a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a', 'volume_size': 1, 'snapshot_id': '03beef24-005c-490b-ac51-48874bb1819b'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34baa3a0-0e17-4184-8d6c-74f5308eb139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Volume volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a (38d49a9a-73a6-44de-ac5c-959688ac9a2a): created successfully Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34baa3a0-0e17-4184-8d6c-74f5308eb139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Flow 'volume_create_manager' (2a2bc006-e849-424c-b214-ea492a027617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-573b361d-0303-410a-ab77-e25d1e235e06 tempest-SnapshotDependencyTests-1100823082 None] Created volume successfully. Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-dd77079f-b1e4-4385-9b6f-67229cf146fe-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-dd77079f-b1e4-4385-9b6f-67229cf146fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-dd77079f-b1e4-4385-9b6f-67229cf146fe" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-dd77079f-b1e4-4385-9b6f-67229cf146fe" acquired by "delete_volume" :: waited 0.013s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3914ad0-9f4f-4ddb-b488-606269017d4d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:47 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe Sep 05 21:07:47 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:47 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe" returned: 0 in 0.367s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:47 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe Sep 05 21:07:47 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-03beef24-005c-490b-ac51-48874bb1819b-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-03beef24-005c-490b-ac51-48874bb1819b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-quobyte-1f8a2e27-99c7-4827-b45f-f8122a865dc3" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-1f8a2e27-99c7-4827-b45f-f8122a865dc3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-quobyte-03beef24-005c-490b-ac51-48874bb1819b" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-03beef24-005c-490b-ac51-48874bb1819b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Deleting offline snapshot 03beef24-005c-490b-ac51-48874bb1819b of volume 1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] snapshot_file for this snap is: volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9d3c83-b251-4fc5-9c67-8d6107da684a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:48 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dd77079f-b1e4-4385-9b6f-67229cf146fe" returned: 0 in 0.268s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:48 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b Sep 05 21:07:48 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-dd77079f-b1e4-4385-9b6f-67229cf146fe" released by "delete_volume" :: held 0.689s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['a5b060c3-ccd9-4792-843c-11d51bfeebe5', 'e2dbb016-3c0c-47ae-a04e-2e5d36294443', '1ba0d295-cadf-4e83-a15d-79d8c41febd3', 'f81b8097-fb29-4721-8103-d5f93e70fdd6'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:48 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:48 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:48 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b" returned: 0 in 0.355s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edce88d-3ada-45f0-8f29-534bc5314d3f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:48 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.255s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Deleted volume successfully. Sep 05 21:07:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9200969e-50c4-4ae7-885d-5cad90bd18c3 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-dd77079f-b1e4-4385-9b6f-67229cf146fe-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:48 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 Sep 05 21:07:48 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3" returned: 0 in 0.558s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b Sep 05 21:07:49 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (9f6b5043-bcd7-4aad-9bcf-0116add3f399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cf5ac3-3ed8-4d8a-ad03-a53e635bc288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cf5ac3-3ed8-4d8a-ad03-a53e635bc288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2098946945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957c1074-51ef-4474-bd26-6ffd6e615fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:49Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18813f08-456d-4b74-b361-386234f5fd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18813f08-456d-4b74-b361-386234f5fd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6414b9-ae0d-4972-893a-be099d5e0930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6414b9-ae0d-4972-893a-be099d5e0930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957c1074-51ef-4474-bd26-6ffd6e615fe7', 'volume_name': 'volume-957c1074-51ef-4474-bd26-6ffd6e615fe7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a516ea-6383-44c5-8bcf-58e5ffb21fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a516ea-6383-44c5-8bcf-58e5ffb21fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee702d76-6afb-4c8b-8eef-2e383e1f2222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:49 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Volume 957c1074-51ef-4474-bd26-6ffd6e615fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957c1074-51ef-4474-bd26-6ffd6e615fe7', 'volume_size': 1} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2098946945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957c1074-51ef-4474-bd26-6ffd6e615fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:49Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Creating volume 957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:49 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 1073741824 Sep 05 21:07:49 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b" returned: 0 in 0.339s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b Sep 05 21:07:49 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3.03beef24-005c-490b-ac51-48874bb1819b" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 1073741824" returned: 0 in 0.431s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-03beef24-005c-490b-ac51-48874bb1819b" released by "_delete_snapshot" :: held 1.609s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-1f8a2e27-99c7-4827-b45f-f8122a865dc3" released by "delete_snapshot" :: held 1.635s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:49 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 Sep 05 21:07:49 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Created reservations ['bb80422c-8668-4abd-8b43-eba5650ac33e', '20848eba-affb-4756-a062-32bb6014e49d', 'd73dc481-9b8f-41f1-82d7-71845b4224d3', '7acd1ced-3218-450d-9395-b97ff1c739d6'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:49 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Delete snapshot completed successfully. Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50d48658-9ea7-468f-b45c-2add0f8db688 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-03beef24-005c-490b-ac51-48874bb1819b-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:49 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7" returned: 0 in 0.247s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:49 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee702d76-6afb-4c8b-8eef-2e383e1f2222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957c1074-51ef-4474-bd26-6ffd6e615fe7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7d21bc-4aec-409a-9693-c591314f9a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:50 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Volume volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 (957c1074-51ef-4474-bd26-6ffd6e615fe7): created successfully Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7d21bc-4aec-409a-9693-c591314f9a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (9f6b5043-bcd7-4aad-9bcf-0116add3f399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f8011508-858b-41a1-9b21-c19a7d8a1a6a tempest-VolumesSnapshotTestJSON-1829696413 None] Created volume successfully. Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-1f8a2e27-99c7-4827-b45f-f8122a865dc3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-1f8a2e27-99c7-4827-b45f-f8122a865dc3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-quobyte-1f8a2e27-99c7-4827-b45f-f8122a865dc3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-1f8a2e27-99c7-4827-b45f-f8122a865dc3" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c73087d-198d-4da6-8f8e-5a5385923bd0]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating offline snapshot 7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc of volume 957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[680fe3d1-0aa1-4814-b825-bd0c98513145]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 Sep 05 21:07:50 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 Sep 05 21:07:50 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3 Sep 05 21:07:50 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7" returned: 0 in 0.377s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:50 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc 1G Sep 05 21:07:50 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:50 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1f8a2e27-99c7-4827-b45f-f8122a865dc3" returned: 0 in 0.252s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-1f8a2e27-99c7-4827-b45f-f8122a865dc3" released by "delete_volume" :: held 0.697s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Created reservations ['a4d51f38-bdfc-4131-a57e-4f3db515ba0c', '8b25c0d1-82b9-4926-afaa-c06ae7b302b7', 'dee97e56-21d0-4128-a0f3-2f73aa6005a2', '383d281d-dc4e-440d-b12e-f98351dc8126'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:51 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc 1G" returned: 0 in 0.419s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc Sep 05 21:07:51 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-38d49a9a-73a6-44de-ac5c-959688ac9a2a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Deleted volume successfully. Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-38d49a9a-73a6-44de-ac5c-959688ac9a2a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2d9e7f29-8223-4d3c-9947-bbc74d27553b tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-1f8a2e27-99c7-4827-b45f-f8122a865dc3-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "cinder-quobyte-38d49a9a-73a6-44de-ac5c-959688ac9a2a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-38d49a9a-73a6-44de-ac5c-959688ac9a2a" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e7908a-b927-4f69-9e0c-267532861fdc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" returned: 0 in 0.337s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc is being set with open permissions: ugo+rw Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc Sep 05 21:07:51 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a Sep 05 21:07:51 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.info Sep 05 21:07:51 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:51 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a" returned: 0 in 0.368s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:51 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a Sep 05 21:07:51 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.info" returned: 0 in 0.276s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.info is being set with open permissions: ugo+rw Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:52 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-38d49a9a-73a6-44de-ac5c-959688ac9a2a" returned: 0 in 0.255s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.info Sep 05 21:07:52 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-quobyte-38d49a9a-73a6-44de-ac5c-959688ac9a2a" released by "delete_volume" :: held 0.667s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Created reservations ['7d0d9566-01b8-4d3a-b941-80cd5621169a', '48d61537-e2dc-49aa-a6c4-99627a0a6073', 'cbde89b3-f676-4b73-8284-ed7146ab9733', '91aaa5fc-c698-421e-afe7-515b9e292fb2'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:52 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:07:52 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:52 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.info" returned: 0 in 0.270s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f193aaea-988d-4877-aad8-56a3141a9376 tempest-VolumesSnapshotTestJSON-1829696413 None] Create snapshot completed successfully Sep 05 21:07:52 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.276s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:07:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Deleted volume successfully. Sep 05 21:07:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f6c5ff0-972a-48c8-b956-fb00ae9aaac4 tempest-SnapshotDependencyTests-1100823082 None] Lock "cinder-38d49a9a-73a6-44de-ac5c-959688ac9a2a-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (4f0a8998-5a7d-4a5c-9bfa-3afe8b9d393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c16983e-f907-40b8-975e-08dd6cf33a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c16983e-f907-40b8-975e-08dd6cf33a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1564783020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0a88e2-03ff-41af-ba52-42b0e89e7885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea24477ef08547b7af0b191e8d25eada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:07:54Z,use_quota=True,user_id='dae3cfab5a754e4fb42180c60defc394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc35624-0e01-453d-b96f-0a8f8e65163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc35624-0e01-453d-b96f-0a8f8e65163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3a0f8b-6c74-44f3-b830-156ecf812085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3a0f8b-6c74-44f3-b830-156ecf812085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bd0a88e2-03ff-41af-ba52-42b0e89e7885', 'volume_name': 'volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885', 'volume_size': 1, 'snapshot_id': '7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545407d2-52e0-4fe7-9300-8668558b791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545407d2-52e0-4fe7-9300-8668558b791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3868fb-6553-41ba-865d-68e430dfba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:07:54 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume bd0a88e2-03ff-41af-ba52-42b0e89e7885: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885', 'volume_size': 1, 'snapshot_id': '7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc'} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc-bd0a88e2-03ff-41af-ba52-42b0e89e7885" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc-bd0a88e2-03ff-41af-ba52-42b0e89e7885" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating volume bd0a88e2-03ff-41af-ba52-42b0e89e7885 from snapshot 7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-bd0a88e2-03ff-41af-ba52-42b0e89e7885" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-bd0a88e2-03ff-41af-ba52-42b0e89e7885" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] snapshot: 7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc, volume: bd0a88e2-03ff-41af-ba52-42b0e89e7885, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cb4696-95b8-42eb-b39f-e3d09b241be6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:54 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc Sep 05 21:07:54 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:54 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" returned: 0 in 0.367s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-957c1074-51ef-4474-bd26-6ffd6e615fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c49c6b-9932-47a9-bbb0-c6975137459d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:07:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:54 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 Sep 05 21:07:54 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:55 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7" returned: 0 in 0.429s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:07:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:07:55 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:07:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:07:55 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 Sep 05 21:07:55 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:07:59 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 05 21:07:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885" returned: 0 in 4.842s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:07:59 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:07:59 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Converted 1024.00 MB image at 211.43 MB/s Sep 05 21:07:59 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 is being set with open permissions: ugo+rw Sep 05 21:07:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:00 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 Sep 05 21:08:00 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:00 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885" returned: 0 in 0.278s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-bd0a88e2-03ff-41af-ba52-42b0e89e7885" released by "_copy_volume_from_snapshot" :: held 5.992s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc-bd0a88e2-03ff-41af-ba52-42b0e89e7885" released by "_create_volume_from_snapshot" :: held 6.070s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.087s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3868fb-6553-41ba-865d-68e430dfba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885', 'volume_size': 1, 'snapshot_id': '7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea07252-4cbf-483a-8ba3-e26610a00700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:00 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Volume volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 (bd0a88e2-03ff-41af-ba52-42b0e89e7885): created successfully Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea07252-4cbf-483a-8ba3-e26610a00700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Flow 'volume_create_manager' (4f0a8998-5a7d-4a5c-9bfa-3afe8b9d393d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:00 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a2b8e155-4f2f-45da-bc34-3fd45606a7f0 tempest-VolumesSnapshotTestJSON-1829696413 None] Created volume successfully. Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-bd0a88e2-03ff-41af-ba52-42b0e89e7885-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-bd0a88e2-03ff-41af-ba52-42b0e89e7885-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-bd0a88e2-03ff-41af-ba52-42b0e89e7885" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-bd0a88e2-03ff-41af-ba52-42b0e89e7885" acquired by "delete_volume" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc60d7c9-03f2-4df4-93e2-535adf2e2724]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 Sep 05 21:08:01 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885" returned: 0 in 0.381s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885 Sep 05 21:08:01 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:01 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bd0a88e2-03ff-41af-ba52-42b0e89e7885" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-bd0a88e2-03ff-41af-ba52-42b0e89e7885" released by "delete_volume" :: held 0.667s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['a9a1dad8-137d-49b3-958f-aa5958d8714d', '5a0004d4-9710-4a23-b385-b5bec1af138e', '931b5fa4-6fe1-47c5-bfb8-c1b6645358f6', 'b238960f-1462-464f-ada1-e4078cba75e8'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:01 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:01 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:02 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.260s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Deleted volume successfully. Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-110cc14e-a0ae-41c6-8672-c3b905b4e107 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-bd0a88e2-03ff-41af-ba52-42b0e89e7885-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-957c1074-51ef-4474-bd26-6ffd6e615fe7" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-957c1074-51ef-4474-bd26-6ffd6e615fe7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Deleting offline snapshot 7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc of volume 957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] snapshot_file for this snap is: volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bada39a-2f8e-477a-aa5c-2c527a9e6b54]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:02 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc Sep 05 21:08:02 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:02 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" returned: 0 in 0.417s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-957c1074-51ef-4474-bd26-6ffd6e615fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d2c7f3-34fd-4f63-bef3-1fd9f1c35b64]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:02 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 Sep 05 21:08:02 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7" returned: 0 in 0.584s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:03 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc Sep 05 21:08:03 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:03 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc Sep 05 21:08:03 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:03 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7.7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc" released by "_delete_snapshot" :: held 1.812s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-957c1074-51ef-4474-bd26-6ffd6e615fe7" released by "delete_snapshot" :: held 1.841s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['2f30ef3f-9acb-4767-b28b-56559e7dc969', '40d92791-b1fc-46db-b391-4d9fa3a8e439', 'fe8f8d6d-7723-43b7-90f0-22748d117786', '451ef1d6-a855-4339-be6f-b7614d27db98'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Delete snapshot completed successfully. Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a197fec9-ebfb-467c-805c-95e89afd8263 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-7dd65e47-9a0b-4855-bd1c-5d3f12f5ebbc-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-957c1074-51ef-4474-bd26-6ffd6e615fe7-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-957c1074-51ef-4474-bd26-6ffd6e615fe7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-957c1074-51ef-4474-bd26-6ffd6e615fe7" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-957c1074-51ef-4474-bd26-6ffd6e615fe7" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdb035a-b719-4c2b-aa82-604ef9b5a3ab]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:04 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 Sep 05 21:08:04 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:04 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7" returned: 0 in 0.380s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:04 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7 Sep 05 21:08:04 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:04 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:04 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:05 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-957c1074-51ef-4474-bd26-6ffd6e615fe7" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.286s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-957c1074-51ef-4474-bd26-6ffd6e615fe7" released by "delete_volume" :: held 0.742s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['3bd1e20d-22f0-4c6b-941b-1a63de47f14d', '33fd109c-46fd-4ca0-8ab9-68601b2956da', 'cb56fa5a-929d-4697-b45c-c7a11910ac8b', 'd2589ee2-c201-4722-9e45-728fe4ff7e22'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:05 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:05 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:05 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Deleted volume successfully. Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-67263b45-5ccf-42e5-a9f4-d9f370184a4f tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-957c1074-51ef-4474-bd26-6ffd6e615fe7-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-828322d0-8b68-4f2f-a874-f67eb1b99aa8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-828322d0-8b68-4f2f-a874-f67eb1b99aa8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "cinder-quobyte-828322d0-8b68-4f2f-a874-f67eb1b99aa8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-828322d0-8b68-4f2f-a874-f67eb1b99aa8" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f510520-2681-4d85-99f4-19b654ec22e6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:05 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 Sep 05 21:08:05 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:06 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8" returned: 0 in 0.362s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:06 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8 Sep 05 21:08:06 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:06 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-828322d0-8b68-4f2f-a874-f67eb1b99aa8" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-quobyte-828322d0-8b68-4f2f-a874-f67eb1b99aa8" released by "delete_volume" :: held 0.665s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Created reservations ['8e071e29-19b6-4a63-9ade-459e72ed5ea8', '921e32ec-813c-47a3-930a-36510cdb6399', '77804d92-57e2-4fe1-a886-c97198487eed', 'c198a29c-5690-4c69-8d63-c8375112251a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:06 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:06 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:06 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.240s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Deleted volume successfully. Sep 05 21:08:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c1193800-9be0-47cb-af9a-fab9e053b560 tempest-VolumesSnapshotTestJSON-1829696413 None] Lock "cinder-828322d0-8b68-4f2f-a874-f67eb1b99aa8-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (68c6e1c8-15b7-4150-9d52-55941b4ea6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90c6b91-866a-4cc1-be38-6c165aff2002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90c6b91-866a-4cc1-be38-6c165aff2002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495924132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:13Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f224e5b5-46cf-4258-b008-99127aadfb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f224e5b5-46cf-4258-b008-99127aadfb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3161ccd1-e57d-4a11-a73a-f61049f1f8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3161ccd1-e57d-4a11-a73a-f61049f1f8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b', 'volume_name': 'volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16532e5c-d3e3-4043-855c-6a954805d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16532e5c-d3e3-4043-855c-6a954805d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40218f24-9a20-44e4-9133-99443416db9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:13 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume 4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b', 'volume_size': 1} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495924132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:13Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Creating volume 4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:13 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:13 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b 1073741824 Sep 05 21:08:13 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:13 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b 1073741824" returned: 0 in 0.398s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:13 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b Sep 05 21:08:13 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:14 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" returned: 0 in 0.255s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40218f24-9a20-44e4-9133-99443416db9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c778baf4-be76-4ed5-9d05-5ced91ab4944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:14 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b (4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b): created successfully Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c778baf4-be76-4ed5-9d05-5ced91ab4944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (68c6e1c8-15b7-4150-9d52-55941b4ea6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fba8229c-13ea-473f-bcb6-4d6555bd7e6d tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created volume successfully. Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Creating offline snapshot 55f09839-2865-48d6-8ef3-cdad98c92428 of volume 4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeef426-8e94-4524-b912-150cc950b811]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:14 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b Sep 05 21:08:14 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:14 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" returned: 0 in 0.349s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:14 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 1G Sep 05 21:08:14 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:15 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 1G" returned: 0 in 0.404s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:15 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 Sep 05 21:08:15 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:15 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428" returned: 0 in 0.280s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:15 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 is being set with open permissions: ugo+rw Sep 05 21:08:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:15 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 Sep 05 21:08:15 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:15 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428" returned: 0 in 0.266s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:15 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.info Sep 05 21:08:15 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:16 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.info" returned: 0 in 0.279s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:16 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.info is being set with open permissions: ugo+rw Sep 05 21:08:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:16 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.info Sep 05 21:08:16 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:16 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.info" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-401e32b4-8364-4093-b352-247a44e84503 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Create snapshot completed successfully Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (9109a804-aa75-4896-9289-de4866c29553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4279abb7-4319-4189-8751-4abdee117f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4279abb7-4319-4189-8751-4abdee117f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731488500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb5a198-e6bb-4c64-b2c0-5d43b3f63782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:17Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dad1425-8302-40fb-9d2f-dade5df21c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dad1425-8302-40fb-9d2f-dade5df21c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bbdf66-2ecb-4feb-b9a0-6858eb648ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bbdf66-2ecb-4feb-b9a0-6858eb648ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb5a198-e6bb-4c64-b2c0-5d43b3f63782', 'volume_name': 'volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfcc0b4-e373-4a78-8a61-231e2da8eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfcc0b4-e373-4a78-8a61-231e2da8eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d62d784-d426-47fb-85b3-46dd9c1b0843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume 9eb5a198-e6bb-4c64-b2c0-5d43b3f63782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782', 'volume_size': 1} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731488500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb5a198-e6bb-4c64-b2c0-5d43b3f63782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:17Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Creating volume 9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:17 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:17 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 1073741824 Sep 05 21:08:17 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=109,cinder:UPDATE=99,cinder:INSERT=28,cinder:DELETE=11 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (270b7f8c-93cf-4193-9e21-c1e7215bf5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba95048f-5ee8-4d1c-b162-14f4c989b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba95048f-5ee8-4d1c-b162-14f4c989b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1933902025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:17Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecc33d1-242b-4d62-8696-a602b36de507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecc33d1-242b-4d62-8696-a602b36de507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aaf8ca-9d93-4f39-8e63-4eab91907cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aaf8ca-9d93-4f39-8e63-4eab91907cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8', 'volume_name': 'volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d6955e-75e0-4243-a3c2-90f20fa72aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d6955e-75e0-4243-a3c2-90f20fa72aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9aaa867-1e82-4f0e-a551-1b46c1955381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8', 'volume_size': 1} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:17 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 1073741824" returned: 0 in 0.468s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=99,cinder:UPDATE=124,cinder:INSERT=29,cinder:DELETE=9 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:17 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 Sep 05 21:08:17 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (e99bb9f0-589c-4078-9adf-cf55b6736312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075779f8-c123-4cf9-b4b0-4b3bf9b6eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075779f8-c123-4cf9-b4b0-4b3bf9b6eff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125152241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1800b62b-f0b7-45be-a630-792093c669f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:18Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a10a74-27e0-4c0f-9f0d-7686db1ebb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a10a74-27e0-4c0f-9f0d-7686db1ebb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab78bfde-87bb-4bef-9915-508acb749f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab78bfde-87bb-4bef-9915-508acb749f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1800b62b-f0b7-45be-a630-792093c669f4', 'volume_name': 'volume-1800b62b-f0b7-45be-a630-792093c669f4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61551db5-3029-40ab-bf21-1c416d2c6798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61551db5-3029-40ab-bf21-1c416d2c6798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ca91b6-e0f3-4053-939f-19b3f8cefdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume 1800b62b-f0b7-45be-a630-792093c669f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1800b62b-f0b7-45be-a630-792093c669f4', 'volume_size': 1} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:17 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782" returned: 0 in 0.277s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1933902025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:17Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Creating volume ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:17 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d62d784-d426-47fb-85b3-46dd9c1b0843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0106a054-4bef-422a-ba52-1258ee8b6270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:17 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 1073741824 Sep 05 21:08:17 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 (9eb5a198-e6bb-4c64-b2c0-5d43b3f63782): created successfully Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0106a054-4bef-422a-ba52-1258ee8b6270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (9109a804-aa75-4896-9289-de4866c29553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b597b4b9-80df-401b-b98a-26518c7fca09 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created volume successfully. Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (2041e5bc-e4a4-4878-9e98-c9de25bbd540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd87e363-2ee9-4437-af1e-f3fe7df58a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd87e363-2ee9-4437-af1e-f3fe7df58a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1365991623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0210a358-9baa-4576-b0d8-4014920d50aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:18Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a7ca76-a68f-40f2-ba88-b6cf43a99e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a7ca76-a68f-40f2-ba88-b6cf43a99e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aed6f5-f1c7-4730-83b4-dc1ca01fbada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aed6f5-f1c7-4730-83b4-dc1ca01fbada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0210a358-9baa-4576-b0d8-4014920d50aa', 'volume_name': 'volume-0210a358-9baa-4576-b0d8-4014920d50aa', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f809804-dafe-422f-9984-c5714977d77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f809804-dafe-422f-9984-c5714977d77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f948d861-78c5-4ea2-9ae8-d78c8d0b267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume 0210a358-9baa-4576-b0d8-4014920d50aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0210a358-9baa-4576-b0d8-4014920d50aa', 'volume_size': 1} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:18 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 1073741824" returned: 0 in 0.549s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:18 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 Sep 05 21:08:18 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (01279c90-e44f-4b7f-83ce-77217a28950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5e2e96-485c-4e47-9d26-318ab6f529dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5e2e96-485c-4e47-9d26-318ab6f529dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1206710436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcce47fe-a556-4b00-9ea3-5d39dfa1f0be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:19Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfec5ce-1e63-4cad-8302-f4329e257d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfec5ce-1e63-4cad-8302-f4329e257d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4206221-aaf3-46bb-b9d9-cd311e2c367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4206221-aaf3-46bb-b9d9-cd311e2c367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcce47fe-a556-4b00-9ea3-5d39dfa1f0be', 'volume_name': 'volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3540a6-b1b0-4ece-96f9-a84c4126c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3540a6-b1b0-4ece-96f9-a84c4126c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab33a554-2d4c-474e-8644-e02c8e53a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume bcce47fe-a556-4b00-9ea3-5d39dfa1f0be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be', 'volume_size': 1} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:18 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2125152241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1800b62b-f0b7-45be-a630-792093c669f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:18Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Creating volume 1800b62b-f0b7-45be-a630-792093c669f4 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:18 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9aaa867-1e82-4f0e-a551-1b46c1955381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739496bd-5e97-4891-8008-b1ab9328bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:18 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 1073741824 Sep 05 21:08:18 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:18 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 (ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8): created successfully Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739496bd-5e97-4891-8008-b1ab9328bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:18 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (270b7f8c-93cf-4193-9e21-c1e7215bf5c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f60ac661-745d-4a18-b168-891fc54498d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created volume successfully. Sep 05 21:08:19 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 1073741824" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:19 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 Sep 05 21:08:19 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:19 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1365991623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0210a358-9baa-4576-b0d8-4014920d50aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:18Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Creating volume 0210a358-9baa-4576-b0d8-4014920d50aa {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:19 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:19 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa 1073741824 Sep 05 21:08:19 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ca91b6-e0f3-4053-939f-19b3f8cefdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1800b62b-f0b7-45be-a630-792093c669f4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c903f0-ceef-4105-b899-e33366574018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:19 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume volume-1800b62b-f0b7-45be-a630-792093c669f4 (1800b62b-f0b7-45be-a630-792093c669f4): created successfully Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c903f0-ceef-4105-b899-e33366574018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (e99bb9f0-589c-4078-9adf-cf55b6736312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:19 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-220c342c-eb27-4b18-bf12-619b9f381c54 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created volume successfully. Sep 05 21:08:19 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa 1073741824" returned: 0 in 0.431s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:19 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa Sep 05 21:08:19 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:20 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa" returned: 0 in 0.252s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1206710436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcce47fe-a556-4b00-9ea3-5d39dfa1f0be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43acffa0affa4f14ad8dbb849334177b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:19Z,use_quota=True,user_id='5cf1788e64af4c2bb1483e227ecbfe55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Creating volume bcce47fe-a556-4b00-9ea3-5d39dfa1f0be {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:20 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f948d861-78c5-4ea2-9ae8-d78c8d0b267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0210a358-9baa-4576-b0d8-4014920d50aa', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:20 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be 1073741824 Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970af62a-3774-456e-93c3-672d76c936a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:20 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume volume-0210a358-9baa-4576-b0d8-4014920d50aa (0210a358-9baa-4576-b0d8-4014920d50aa): created successfully Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970af62a-3774-456e-93c3-672d76c936a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (2041e5bc-e4a4-4878-9e98-c9de25bbd540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0ce6ad5a-03a0-4028-908e-2f93a4a5bf32 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created volume successfully. Sep 05 21:08:20 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be 1073741824" returned: 0 in 0.418s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:20 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be Sep 05 21:08:20 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:20 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab33a554-2d4c-474e-8644-e02c8e53a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a803c4-6319-4110-8642-14fe03265412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Volume volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be (bcce47fe-a556-4b00-9ea3-5d39dfa1f0be): created successfully Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a803c4-6319-4110-8642-14fe03265412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Flow 'volume_create_manager' (01279c90-e44f-4b7f-83ce-77217a28950f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:20 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-57830e5e-c31f-44ec-a51b-9567511996d1 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created volume successfully. Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e894528-7a45-4983-8a07-6c479dd3c484]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:22 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be Sep 05 21:08:22 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:22 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be" returned: 0 in 0.365s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:22 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be Sep 05 21:08:22 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:22 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be" released by "delete_volume" :: held 0.656s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created reservations ['f2eb70d7-e096-4025-8268-194bed87f4b3', 'f2c42d9e-ff8f-4f22-bf1c-352909bb050d', 'f5b64fc9-a52c-4610-98c5-958a028779d5', '0c5c2589-f48f-48c2-88ac-b4a99d15fc15'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:22 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:22 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:23 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.242s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:23 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Deleted volume successfully. Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-45cb91de-1ce4-4cfd-800c-de88a8f464a7 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-bcce47fe-a556-4b00-9ea3-5d39dfa1f0be-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-0210a358-9baa-4576-b0d8-4014920d50aa-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-0210a358-9baa-4576-b0d8-4014920d50aa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-0210a358-9baa-4576-b0d8-4014920d50aa" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-0210a358-9baa-4576-b0d8-4014920d50aa" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[725ec725-4ec7-45c9-ad5a-3c341c631eea]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:23 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa Sep 05 21:08:23 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:23 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa" returned: 0 in 0.360s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:23 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa Sep 05 21:08:23 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:23 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-0210a358-9baa-4576-b0d8-4014920d50aa" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-0210a358-9baa-4576-b0d8-4014920d50aa" released by "delete_volume" :: held 0.651s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created reservations ['36b0860b-8c34-45cc-972f-7b823d019162', 'f1a5bfb4-1320-459c-abcf-0d2257dc7f80', '05a94e3d-bc1c-4390-b4d6-87ec321336ab', 'ea5f3596-1916-4519-819c-160b38535edd'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:24 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:24 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:24 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Deleted volume successfully. Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-d05a9bf9-f27c-4ab8-9178-af0f09510885 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-0210a358-9baa-4576-b0d8-4014920d50aa-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-1800b62b-f0b7-45be-a630-792093c669f4-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-1800b62b-f0b7-45be-a630-792093c669f4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-1800b62b-f0b7-45be-a630-792093c669f4" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-1800b62b-f0b7-45be-a630-792093c669f4" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[300c97fe-9cac-46a4-b7dc-075c795dcf87]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:24 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 Sep 05 21:08:24 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:24 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4" returned: 0 in 0.401s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:24 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4 Sep 05 21:08:24 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:25 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1800b62b-f0b7-45be-a630-792093c669f4" returned: 0 in 0.242s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-1800b62b-f0b7-45be-a630-792093c669f4" released by "delete_volume" :: held 0.682s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created reservations ['1fd22047-9909-434e-8f0e-7840edcb3aa9', '293a6446-e71d-4857-b92f-0ddb5474e7de', '51939660-752c-42d0-8802-edb24a4b32d4', '76feac08-ea91-4e22-9e82-e9cbc1b00001'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:25 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:25 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:25 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.257s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Deleted volume successfully. Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6da13161-5423-4eb2-b772-6bf17a2222b4 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-1800b62b-f0b7-45be-a630-792093c669f4-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8" acquired by "delete_volume" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5ad31-4928-42b9-b4bd-90b58d43a4d6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:25 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 Sep 05 21:08:25 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:25 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:25 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8 Sep 05 21:08:26 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:26 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8" released by "delete_volume" :: held 0.645s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created reservations ['ef9d9cbb-5bc7-433a-85cb-436fed134f59', '0a782638-4d20-4699-aa91-ddb26a6a9608', 'ac60c64f-f587-433a-b933-4fbbe403b83c', 'd0152850-acbd-47e9-aeaa-7d7e57283c5d'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:26 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:26 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:26 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.255s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Deleted volume successfully. Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bbb028f4-23ec-442e-be2a-1e0983f4c772 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-ce834dad-a5a2-4ba4-9492-17e1ee9e2ec8-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[760b8a3e-65e1-4262-b25a-ccda367ee7d4]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:26 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 Sep 05 21:08:26 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:27 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782" returned: 0 in 0.355s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:27 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782 Sep 05 21:08:27 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:27 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782" released by "delete_volume" :: held 0.641s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created reservations ['18eb6f8c-a7a7-4e23-af78-1edd5f5032a0', '6d6c53c2-8241-4f24-abae-d36086b31d0e', '3e11081e-e376-4844-87fe-6ecf7ed2e77f', '600ab366-b06d-4c16-a636-1feaed6160d6'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:27 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:27 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:27 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.244s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Deleted volume successfully. Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-856fc9cb-c5f8-46b8-a3d1-cf03adeeed44 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-9eb5a198-e6bb-4c64-b2c0-5d43b3f63782-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-55f09839-2865-48d6-8ef3-cdad98c92428-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-55f09839-2865-48d6-8ef3-cdad98c92428-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-55f09839-2865-48d6-8ef3-cdad98c92428" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-55f09839-2865-48d6-8ef3-cdad98c92428" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Deleting offline snapshot 55f09839-2865-48d6-8ef3-cdad98c92428 of volume 4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] snapshot_file for this snap is: volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8de217-e3ff-4b32-8d57-4362e1b70c9f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:28 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 Sep 05 21:08:28 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:28 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428" returned: 0 in 0.348s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f81e3-f636-4440-ad7c-e77a5630e2f6]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:28 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b Sep 05 21:08:28 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:28 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" returned: 0 in 0.351s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:28 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 Sep 05 21:08:28 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:28 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428" returned: 0 in 0.342s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:29 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428 Sep 05 21:08:29 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:29 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b.55f09839-2865-48d6-8ef3-cdad98c92428" returned: 0 in 0.251s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-55f09839-2865-48d6-8ef3-cdad98c92428" released by "_delete_snapshot" :: held 1.389s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" released by "delete_snapshot" :: held 1.411s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:29 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created reservations ['1ae178da-7b98-4e96-b949-05f6bf9a61da', '24883536-e000-44e6-8354-a3bddb40c9f2', 'd98ce362-4023-4891-b0e0-9f3845f9a04e', '43f8fd07-278f-4b41-a112-ff28983f8df2'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:29 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Delete snapshot completed successfully. Sep 05 21:08:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-314bb15e-cd80-49e0-afae-917265bc0306 tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-55f09839-2865-48d6-8ef3-cdad98c92428-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "cinder-quobyte-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" acquired by "delete_volume" :: waited 0.013s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac1a0ea-e1b0-48be-86e1-9a71d08ee5be]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:30 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b Sep 05 21:08:30 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:30 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:30 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b Sep 05 21:08:30 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:30 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" returned: 0 in 0.244s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-quobyte-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b" released by "delete_volume" :: held 0.647s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Created reservations ['437d1bdc-0393-4efb-8014-81609a84b59a', '445ed25b-d202-4424-9e58-6dfe55a3de3e', 'd059d6b8-ed08-4b8c-8862-8b2753e2c3eb', 'ea948dfe-bca0-434a-b99a-1fe4e0734335'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:30 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:30 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:31 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.266s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:31 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Deleted volume successfully. Sep 05 21:08:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-92265fe1-f601-4fac-986b-3bc52509d42f tempest-CreateVolumesFromSnapshotTest-2065930110 None] Lock "cinder-4a4fd23c-a9c6-4cb2-897e-d5e79e074d9b-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (e1ee0c2b-b7e6-4762-a2c0-5cce045771e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfe2730-0f72-4b9b-81b5-1e2329c71d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfe2730-0f72-4b9b-81b5-1e2329c71d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595095015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b5bbae-e457-4492-8574-43dc86fdf953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:39Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f7ee78-7864-44ab-b34e-270fc3b7c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f7ee78-7864-44ab-b34e-270fc3b7c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af22fce-960b-4211-9915-d6a62b5edf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af22fce-960b-4211-9915-d6a62b5edf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b5bbae-e457-4492-8574-43dc86fdf953', 'volume_name': 'volume-e3b5bbae-e457-4492-8574-43dc86fdf953', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f8c287-1e94-4b83-9ff8-9bac67150fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f8c287-1e94-4b83-9ff8-9bac67150fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d332058-06b6-4120-8af2-f8514034274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:38 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Volume e3b5bbae-e457-4492-8574-43dc86fdf953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b5bbae-e457-4492-8574-43dc86fdf953', 'volume_size': 1} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595095015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b5bbae-e457-4492-8574-43dc86fdf953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:39Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Creating volume e3b5bbae-e457-4492-8574-43dc86fdf953 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:38 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:38 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 1073741824 Sep 05 21:08:38 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:39 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 1073741824" returned: 0 in 0.421s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:39 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 Sep 05 21:08:39 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:39 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953" returned: 0 in 0.247s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d332058-06b6-4120-8af2-f8514034274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b5bbae-e457-4492-8574-43dc86fdf953', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e021baf0-f867-40fe-9c30-5bb3964381d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:39 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Volume volume-e3b5bbae-e457-4492-8574-43dc86fdf953 (e3b5bbae-e457-4492-8574-43dc86fdf953): created successfully Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e021baf0-f867-40fe-9c30-5bb3964381d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (e1ee0c2b-b7e6-4762-a2c0-5cce045771e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:39 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e0877f04-7988-4a4a-8213-0d5957fce3a8 tempest-ProjectReaderTests-1214729591 None] Created volume successfully. Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-e3b5bbae-e457-4492-8574-43dc86fdf953-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-e3b5bbae-e457-4492-8574-43dc86fdf953-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-quobyte-e3b5bbae-e457-4492-8574-43dc86fdf953" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-e3b5bbae-e457-4492-8574-43dc86fdf953" acquired by "delete_volume" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee63151b-2550-486b-8017-73f8e28c0d5e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:39 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 Sep 05 21:08:39 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:40 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953" returned: 0 in 0.360s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:40 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953 Sep 05 21:08:40 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:40 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e3b5bbae-e457-4492-8574-43dc86fdf953" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-e3b5bbae-e457-4492-8574-43dc86fdf953" released by "delete_volume" :: held 0.642s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Created reservations ['7428103c-70bc-4ce5-a105-96e16c883d66', 'c10042f5-d097-4e1f-b05c-d9666bb3ca25', '4c097194-7832-418a-928d-23948e758a68', '164f60c3-52a0-4ec4-8f0a-05835917ade2'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:40 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:40 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:40 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.248s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Deleted volume successfully. Sep 05 21:08:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-33f2b255-e193-4131-ab8e-73baf2ea5b77 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-e3b5bbae-e457-4492-8574-43dc86fdf953-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (68c77834-1aa3-4def-8c51-3bf71eae5504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1def971-7126-498c-812f-adce53be9efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1def971-7126-498c-812f-adce53be9efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949901416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a6cb39-ac0c-4725-942f-48fa85cd0e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:41Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62642408-356e-4f4f-8327-0a0971a4e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62642408-356e-4f4f-8327-0a0971a4e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375d0c52-a3a1-41de-a11f-84ac2a162510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375d0c52-a3a1-41de-a11f-84ac2a162510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a6cb39-ac0c-4725-942f-48fa85cd0e83', 'volume_name': 'volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bbd2d4-970b-4d61-8909-59cdbd929768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89bbd2d4-970b-4d61-8909-59cdbd929768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea5b1f2-5fd5-463b-ae41-e9229f7586a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Volume 39a6cb39-ac0c-4725-942f-48fa85cd0e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83', 'volume_size': 1} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-949901416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a6cb39-ac0c-4725-942f-48fa85cd0e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:41Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Creating volume 39a6cb39-ac0c-4725-942f-48fa85cd0e83 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:41 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:41 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 1073741824 Sep 05 21:08:41 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:41 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 1073741824" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:41 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 Sep 05 21:08:41 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:42 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea5b1f2-5fd5-463b-ae41-e9229f7586a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab7f5d4-7605-4dfb-bfec-22790fa71b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:42 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Volume volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 (39a6cb39-ac0c-4725-942f-48fa85cd0e83): created successfully Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab7f5d4-7605-4dfb-bfec-22790fa71b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (68c77834-1aa3-4def-8c51-3bf71eae5504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2d9928d9-15e2-424e-8a0f-18917ad61cb9 tempest-ProjectReaderTests-1214729591 None] Created volume successfully. Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-39a6cb39-ac0c-4725-942f-48fa85cd0e83-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-39a6cb39-ac0c-4725-942f-48fa85cd0e83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-quobyte-39a6cb39-ac0c-4725-942f-48fa85cd0e83" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-39a6cb39-ac0c-4725-942f-48fa85cd0e83" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5cb73-d37e-4a08-afe6-f76d6b43840f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:42 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 Sep 05 21:08:42 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:42 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83" returned: 0 in 0.366s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:42 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83 Sep 05 21:08:42 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:43 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-39a6cb39-ac0c-4725-942f-48fa85cd0e83" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-39a6cb39-ac0c-4725-942f-48fa85cd0e83" released by "delete_volume" :: held 0.667s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Created reservations ['0dd9e19c-2914-4e7a-8407-242c6efa3fe1', 'de7f6d20-4429-43cc-ba1e-bbc7bc55619d', 'a3bf11f1-2d2a-4139-9efe-ca864f1f9ba8', 'd0c8bdf0-9fee-4482-97aa-5b1629bec172'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:43 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:43 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:43 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Deleted volume successfully. Sep 05 21:08:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2182fb82-eaef-45b1-a14d-66d1f5cc3464 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-39a6cb39-ac0c-4725-942f-48fa85cd0e83-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (ae075184-4cfb-49d7-a86a-c872f75fb271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e768a94c-c1b5-4fc3-856e-515724d26ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e768a94c-c1b5-4fc3-856e-515724d26ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292099140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baf0db-b560-43f0-9d00-b41354d1da8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:44Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434320c6-9155-487a-b006-988724b18de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434320c6-9155-487a-b006-988724b18de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2533dbe6-1895-4a06-886a-b9544a970428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2533dbe6-1895-4a06-886a-b9544a970428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69baf0db-b560-43f0-9d00-b41354d1da8e', 'volume_name': 'volume-69baf0db-b560-43f0-9d00-b41354d1da8e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30796e0-eca6-4e4b-b3b2-f981ef74866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30796e0-eca6-4e4b-b3b2-f981ef74866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0730975-f2f9-4f51-b748-7ffefac24aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:44 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Volume 69baf0db-b560-43f0-9d00-b41354d1da8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69baf0db-b560-43f0-9d00-b41354d1da8e', 'volume_size': 1} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-292099140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69baf0db-b560-43f0-9d00-b41354d1da8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:44Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Creating volume 69baf0db-b560-43f0-9d00-b41354d1da8e {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:44 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:44 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e 1073741824 Sep 05 21:08:44 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:44 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e 1073741824" returned: 0 in 0.411s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:44 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e Sep 05 21:08:44 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:44 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e" returned: 0 in 0.247s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0730975-f2f9-4f51-b748-7ffefac24aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69baf0db-b560-43f0-9d00-b41354d1da8e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808387af-0299-4b00-9806-33f4d3c00ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:44 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Volume volume-69baf0db-b560-43f0-9d00-b41354d1da8e (69baf0db-b560-43f0-9d00-b41354d1da8e): created successfully Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808387af-0299-4b00-9806-33f4d3c00ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (ae075184-4cfb-49d7-a86a-c872f75fb271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:44 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-781fc94e-84db-4558-bb63-c788670ada63 tempest-ProjectReaderTests-1214729591 None] Created volume successfully. Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-69baf0db-b560-43f0-9d00-b41354d1da8e-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-69baf0db-b560-43f0-9d00-b41354d1da8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-quobyte-69baf0db-b560-43f0-9d00-b41354d1da8e" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-69baf0db-b560-43f0-9d00-b41354d1da8e" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d85dda-9d14-4762-b54e-41283150c6bd]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:45 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e Sep 05 21:08:45 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:45 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e" returned: 0 in 0.353s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:45 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e Sep 05 21:08:45 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:45 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-69baf0db-b560-43f0-9d00-b41354d1da8e" returned: 0 in 0.257s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-69baf0db-b560-43f0-9d00-b41354d1da8e" released by "delete_volume" :: held 0.646s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Created reservations ['075a32c7-8b74-4f02-943a-3d71bfcc28da', '43eb7221-6b0e-437b-af05-762070a9d108', '3ef3c6a9-4b4f-4e8f-be86-55445546c731', '21ee74d6-2901-4753-b6a0-853186a943f5'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:46 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:46 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:46 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Deleted volume successfully. Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f2108a98-dea8-4eaa-b4f6-c35261a498b5 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-69baf0db-b560-43f0-9d00-b41354d1da8e-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (04994a97-28e1-41f0-a908-c58afea1453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae9538a-394c-4d13-9d43-f28d2d4f0f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae9538a-394c-4d13-9d43-f28d2d4f0f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737904217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bb1d24-322f-4177-9533-85cc10f4fbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:47Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad02eb-ed56-49b6-97a0-b8787a742b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad02eb-ed56-49b6-97a0-b8787a742b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ff544-d3d6-4fec-8827-8581fcbc1f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ff544-d3d6-4fec-8827-8581fcbc1f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bb1d24-322f-4177-9533-85cc10f4fbfd', 'volume_name': 'volume-07bb1d24-322f-4177-9533-85cc10f4fbfd', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3852488b-9a0b-46a9-a772-6a6e239c29fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3852488b-9a0b-46a9-a772-6a6e239c29fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce71ea-ea76-41bf-adcb-b9544b50c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Volume 07bb1d24-322f-4177-9533-85cc10f4fbfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bb1d24-322f-4177-9533-85cc10f4fbfd', 'volume_size': 1} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737904217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bb1d24-322f-4177-9533-85cc10f4fbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f016c9bab0bb4c5c8d17036dfdaa4f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:08:47Z,use_quota=True,user_id='d66aa6ee538848669b3f2b59e3c623a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Creating volume 07bb1d24-322f-4177-9533-85cc10f4fbfd {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:08:46 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:08:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:46 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd 1073741824 Sep 05 21:08:46 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:47 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd 1073741824" returned: 0 in 0.408s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:47 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd Sep 05 21:08:47 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:47 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd" returned: 0 in 0.237s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ce71ea-ea76-41bf-adcb-b9544b50c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bb1d24-322f-4177-9533-85cc10f4fbfd', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859c2fce-533f-454d-bfde-40ee077225bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:08:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Volume volume-07bb1d24-322f-4177-9533-85cc10f4fbfd (07bb1d24-322f-4177-9533-85cc10f4fbfd): created successfully Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859c2fce-533f-454d-bfde-40ee077225bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Flow 'volume_create_manager' (04994a97-28e1-41f0-a908-c58afea1453d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:08:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4fa59e3f-0009-49d6-b394-6be9ea2342f6 tempest-ProjectReaderTests-1214729591 None] Created volume successfully. Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-07bb1d24-322f-4177-9533-85cc10f4fbfd-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-07bb1d24-322f-4177-9533-85cc10f4fbfd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "cinder-quobyte-07bb1d24-322f-4177-9533-85cc10f4fbfd" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-07bb1d24-322f-4177-9533-85cc10f4fbfd" acquired by "delete_volume" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0910a0d-bda2-4b19-af44-c586d93150c8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:08:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:47 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd Sep 05 21:08:47 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:48 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd" returned: 0 in 0.356s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:48 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd Sep 05 21:08:48 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:48 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-07bb1d24-322f-4177-9533-85cc10f4fbfd" returned: 0 in 0.238s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-quobyte-07bb1d24-322f-4177-9533-85cc10f4fbfd" released by "delete_volume" :: held 0.630s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Created reservations ['20f6529b-430c-40af-8c6f-e6beea234586', 'a008c77f-004f-40bf-998d-562e467399ee', '992ad850-1cae-460a-a73e-0629ca511194', '5bba18f7-6a6b-4635-a8e3-d03e2a50379c'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:08:48 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:08:48 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:08:48 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.248s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:08:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Deleted volume successfully. Sep 05 21:08:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-823c9888-08cd-4ae3-950e-21c472536841 tempest-ProjectReaderTests-1214729591 None] Lock "cinder-07bb1d24-322f-4177-9533-85cc10f4fbfd-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:08:58 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=113,cinder:SELECT=71,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:08:58 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=110,cinder:DELETE=14,cinder:SELECT=71,cinder:INSERT=32 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (590d8841-0a0b-46c9-a108-80d684cc0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08da4d11-03de-4513-88e7-ebbee5212e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08da4d11-03de-4513-88e7-ebbee5212e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-549851015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c1c5c8-c727-4581-b1a9-bba29836dc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:01Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04eefcc0-0f01-476c-88ad-4f0131d7258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04eefcc0-0f01-476c-88ad-4f0131d7258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e986a321-977c-4679-8bca-b830e5d2292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e986a321-977c-4679-8bca-b830e5d2292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c1c5c8-c727-4581-b1a9-bba29836dc30', 'volume_name': 'volume-26c1c5c8-c727-4581-b1a9-bba29836dc30', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584cf049-d6d1-448c-a4e8-0030209090b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584cf049-d6d1-448c-a4e8-0030209090b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ea7f3a-d9be-4320-b19d-aac96d0a5133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:00 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume 26c1c5c8-c727-4581-b1a9-bba29836dc30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c1c5c8-c727-4581-b1a9-bba29836dc30', 'volume_size': 1} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-549851015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c1c5c8-c727-4581-b1a9-bba29836dc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:01Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Creating volume 26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:00 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:00 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 1073741824 Sep 05 21:09:00 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:01 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 1073741824" returned: 0 in 0.444s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:01 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 Sep 05 21:09:01 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (1ee83020-a364-4025-b645-2e757297369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d616ce7-4431-45fe-84fd-eefb62b91c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d616ce7-4431-45fe-84fd-eefb62b91c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796083694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50735427-9d0c-44da-bcf3-8b02e2a085d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:01Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3d0619-fece-4b83-a652-149a8ddfee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3d0619-fece-4b83-a652-149a8ddfee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6202223-0cf0-42ac-9fbd-3a67b2dd663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6202223-0cf0-42ac-9fbd-3a67b2dd663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50735427-9d0c-44da-bcf3-8b02e2a085d3', 'volume_name': 'volume-50735427-9d0c-44da-bcf3-8b02e2a085d3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d96381-9a0b-4562-930b-bda02ea4ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d96381-9a0b-4562-930b-bda02ea4ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53aeacde-fed1-44e3-af2e-b0c003b68f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:01 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Volume 50735427-9d0c-44da-bcf3-8b02e2a085d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50735427-9d0c-44da-bcf3-8b02e2a085d3', 'volume_size': 1} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:01 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796083694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50735427-9d0c-44da-bcf3-8b02e2a085d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:01Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Creating volume 50735427-9d0c-44da-bcf3-8b02e2a085d3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:01 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ea7f3a-d9be-4320-b19d-aac96d0a5133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c1c5c8-c727-4581-b1a9-bba29836dc30', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdb522d-891d-45e5-821a-bf89a0fec445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:01 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 (26c1c5c8-c727-4581-b1a9-bba29836dc30): created successfully Sep 05 21:09:01 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 1073741824 Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdb522d-891d-45e5-821a-bf89a0fec445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:01 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (590d8841-0a0b-46c9-a108-80d684cc0304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9df69af4-dbb2-4f36-a1bd-9ba4cdcdfbad tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created volume successfully. Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Flow 'volume_create_manager' (a52a80ba-5038-4c61-a3b2-7226dccfb826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df0600-6f02-4d4b-be49-4953ce4594e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7df0600-6f02-4d4b-be49-4953ce4594e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-847524106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce2d291-e180-4734-83d6-a571760fd4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f122b54aec84b2ebec283ef07c13a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:02Z,use_quota=True,user_id='d72ef6c1d4884eb88f6fd5426b529eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff97d2bd-5bbb-46ed-93ed-6f84c641dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff97d2bd-5bbb-46ed-93ed-6f84c641dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefdd543-89c7-450e-ab24-91cba6374607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefdd543-89c7-450e-ab24-91cba6374607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce2d291-e180-4734-83d6-a571760fd4eb', 'volume_name': 'volume-1ce2d291-e180-4734-83d6-a571760fd4eb', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21a2951-ab68-4164-9d31-6d63df538ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21a2951-ab68-4164-9d31-6d63df538ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc32b01b-08a9-49bc-b098-5082864f31dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Volume 1ce2d291-e180-4734-83d6-a571760fd4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce2d291-e180-4734-83d6-a571760fd4eb', 'volume_size': 1} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:02 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 1073741824" returned: 0 in 0.638s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (37e525ee-9eaf-41f3-b92a-b1505cef84d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdb6621-0025-47db-8119-f4771d440638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdb6621-0025-47db-8119-f4771d440638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983841606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d99dfff-0f17-4ba1-8153-26ecf864acac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:02Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38b9308-16f1-4c99-a13b-a3f7b9cb11c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d38b9308-16f1-4c99-a13b-a3f7b9cb11c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677408c7-d88a-481f-b170-5911911b602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677408c7-d88a-481f-b170-5911911b602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d99dfff-0f17-4ba1-8153-26ecf864acac', 'volume_name': 'volume-3d99dfff-0f17-4ba1-8153-26ecf864acac', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ec4d11-f5b6-4dc0-a1dc-01127dcc4069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ec4d11-f5b6-4dc0-a1dc-01127dcc4069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c43c8ae-cb8a-4588-99b8-ff1f5dc0bdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Volume 3d99dfff-0f17-4ba1-8153-26ecf864acac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d99dfff-0f17-4ba1-8153-26ecf864acac', 'volume_size': 1} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:02 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 Sep 05 21:09:02 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (ea73b1ec-0747-40d4-87b0-e67e34c6e271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ee5069-0b96-4e47-a8db-d2c08291ec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ee5069-0b96-4e47-a8db-d2c08291ec5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735568599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:03Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9908e1-4aaf-48b8-a94d-1abc113bf71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9908e1-4aaf-48b8-a94d-1abc113bf71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9ef8b9-f6ac-45db-8195-5112f15aa67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9ef8b9-f6ac-45db-8195-5112f15aa67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e', 'volume_name': 'volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559fc6e3-1d9d-4ff4-a3ad-7baf55e4710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559fc6e3-1d9d-4ff4-a3ad-7baf55e4710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d07286b-66ce-44aa-9db4-3dfcc2fa4113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Volume dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e', 'volume_size': 1} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:02 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3" returned: 0 in 0.376s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-847524106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce2d291-e180-4734-83d6-a571760fd4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f122b54aec84b2ebec283ef07c13a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:02Z,use_quota=True,user_id='d72ef6c1d4884eb88f6fd5426b529eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Creating volume 1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:02 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:02 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb 1073741824 Sep 05 21:09:02 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53aeacde-fed1-44e3-af2e-b0c003b68f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50735427-9d0c-44da-bcf3-8b02e2a085d3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53da158f-ad64-4d5d-aba2-da52462f7a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Volume volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 (50735427-9d0c-44da-bcf3-8b02e2a085d3): created successfully Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53da158f-ad64-4d5d-aba2-da52462f7a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (1ee83020-a364-4025-b645-2e757297369b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e2cd76ae-db59-4216-9580-69b00a902579 tempest-CreateVolumesFromImageTest-405682178 None] Created volume successfully. Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (959df7a2-0830-4ea2-a80e-ac3da5ad24b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d13cf0-8a9b-4b84-88bb-8eb389d413ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d13cf0-8a9b-4b84-88bb-8eb389d413ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-418263002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5534f84-7b27-4c80-8ac4-01037e116b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:03Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24415ab4-47c4-4e8c-9915-ca4f9af979ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24415ab4-47c4-4e8c-9915-ca4f9af979ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0194979e-1f53-461c-8d1d-f8c09a554322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0194979e-1f53-461c-8d1d-f8c09a554322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5534f84-7b27-4c80-8ac4-01037e116b5a', 'volume_name': 'volume-c5534f84-7b27-4c80-8ac4-01037e116b5a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23951c21-683b-4f09-aa0b-0aa46be7b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23951c21-683b-4f09-aa0b-0aa46be7b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ef69fd-481d-4f25-9332-d532368dd662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Volume c5534f84-7b27-4c80-8ac4-01037e116b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5534f84-7b27-4c80-8ac4-01037e116b5a', 'volume_size': 1} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:03 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb 1073741824" returned: 0 in 0.648s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:03 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb Sep 05 21:09:03 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (2ca31a3c-4093-4c09-943f-415e536faf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a636e4b-90bc-41e8-acdb-6bd316be774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a636e4b-90bc-41e8-acdb-6bd316be774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078349845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b3390f-9c83-4846-ba54-7e5cd4e299fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:04Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d2742a-9529-4a70-8149-91b0f4b7dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d2742a-9529-4a70-8149-91b0f4b7dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4fc039-1bc2-4334-9e21-472b9888ba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4fc039-1bc2-4334-9e21-472b9888ba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b3390f-9c83-4846-ba54-7e5cd4e299fd', 'volume_name': 'volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6f43bd-508b-4c08-bbc9-1de15f58bae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6f43bd-508b-4c08-bbc9-1de15f58bae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de5ab94-c7a5-4afa-9087-4a4a8a0cf5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Volume 57b3390f-9c83-4846-ba54-7e5cd4e299fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd', 'volume_size': 1} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:03 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb" returned: 0 in 0.276s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983841606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d99dfff-0f17-4ba1-8153-26ecf864acac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:02Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Creating volume 3d99dfff-0f17-4ba1-8153-26ecf864acac {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:03 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc32b01b-08a9-49bc-b098-5082864f31dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce2d291-e180-4734-83d6-a571760fd4eb', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9db50a-3fdf-44a8-b6ef-c7f294ffbe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:03 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac 1073741824 Sep 05 21:09:03 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:03 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Volume volume-1ce2d291-e180-4734-83d6-a571760fd4eb (1ce2d291-e180-4734-83d6-a571760fd4eb): created successfully Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9db50a-3fdf-44a8-b6ef-c7f294ffbe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:03 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Flow 'volume_create_manager' (a52a80ba-5038-4c61-a3b2-7226dccfb826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:03 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9df90450-9386-462f-9a13-6747d535f370 tempest-VolumeDependencyTests-500778702 None] Created volume successfully. Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:04 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac 1073741824" returned: 0 in 0.498s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:04 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac Sep 05 21:09:04 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:04 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735568599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:03Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Creating volume dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:04 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:04 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e 1073741824 Sep 05 21:09:04 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c43c8ae-cb8a-4588-99b8-ff1f5dc0bdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d99dfff-0f17-4ba1-8153-26ecf864acac', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0353c32-74cc-4d1a-920c-c3ca63bf451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:04 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Volume volume-3d99dfff-0f17-4ba1-8153-26ecf864acac (3d99dfff-0f17-4ba1-8153-26ecf864acac): created successfully Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0353c32-74cc-4d1a-920c-c3ca63bf451f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (37e525ee-9eaf-41f3-b92a-b1505cef84d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-716a5b82-29a9-4577-9db1-5fed0fbff058 tempest-CreateVolumesFromImageTest-405682178 None] Created volume successfully. Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:04 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:04 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:05 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e 1073741824" returned: 0 in 0.488s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:05 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.267s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:05 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e Sep 05 21:09:05 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Flow 'volume_create_manager' (ad260280-cd08-4ca1-bf16-e51a4a056a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a911236d-6936-4ef9-8b64-4649b84440c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a911236d-6936-4ef9-8b64-4649b84440c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7948a8c2-6a79-444e-a24f-3960e01b97b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8a748c10834067aaf09c0944912d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:05Z,use_quota=True,user_id='bc0d52aae79b491a957bc43f5d1b020f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7933c13b-9a30-4ff1-b8e3-d10f02b55132),volume_type_id=7933c13b-9a30-4ff1-b8e3-d10f02b55132)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85851c85-0cfd-49c9-a337-571b337265a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85851c85-0cfd-49c9-a337-571b337265a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d693a697-cc2c-4e97-bba7-7b78b431c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:09:05 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e" returned: 0 in 0.254s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.608s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Creating offline snapshot e2d024be-4937-4e1b-b263-0016dbad06a3 of volume 26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d07286b-66ce-44aa-9db4-3dfcc2fa4113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627276e-be70-449f-a4df-5d12f46f013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83839a7-937f-4651-bd19-b608de9e01a2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:05 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Volume volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e (dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e): created successfully Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627276e-be70-449f-a4df-5d12f46f013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (ea73b1ec-0747-40d4-87b0-e67e34c6e271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:05 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cbd5dfae-4dfb-4d23-b42d-7b1fff9c9e46 tempest-CreateVolumesFromImageTest-405682178 None] Created volume successfully. Sep 05 21:09:05 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 Sep 05 21:09:05 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d693a697-cc2c-4e97-bba7-7b78b431c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7948a8c2-6a79-444e-a24f-3960e01b97b3', 'volume_name': 'volume-7948a8c2-6a79-444e-a24f-3960e01b97b3', 'volume_size': 1, 'image_id': '32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caf2bc6ef3af24d0e9cb7cf1e527a46d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e8a748c10834067aaf09c0944912d35', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ac799cb8f2356218e5f9f9b8aff65d0d5e13267b7d1cc22a02c753ea631f8f6806c6b004f212e9787244a655afe9a17b3525ea83b4a42d6001e3efd603e10d7', 'id': '32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'created_at': datetime.datetime(2026, 9, 5, 19, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e9ae30-1dd2-4468-9ea0-a05b660d93bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e9ae30-1dd2-4468-9ea0-a05b660d93bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656f7224-af2b-4450-86aa-377fcd891aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:05 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Volume 7948a8c2-6a79-444e-a24f-3960e01b97b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7948a8c2-6a79-444e-a24f-3960e01b97b3', 'volume_size': 1, 'image_id': '32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caf2bc6ef3af24d0e9cb7cf1e527a46d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e8a748c10834067aaf09c0944912d35', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ac799cb8f2356218e5f9f9b8aff65d0d5e13267b7d1cc22a02c753ea631f8f6806c6b004f212e9787244a655afe9a17b3525ea83b4a42d6001e3efd603e10d7', 'id': '32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'created_at': datetime.datetime(2026, 9, 5, 19, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Trying to clone 7948a8c2-6a79-444e-a24f-3960e01b97b3 from image 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:09:05 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92763e2-cea6-4d28-8c41-db886d3dbabd]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:05 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30" returned: 0 in 0.405s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:05 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 1G Sep 05 21:09:05 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:05 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD Sep 05 21:09:05 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:06 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:06 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 1G" returned: 0 in 0.410s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:06 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD Sep 05 21:09:06 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:06 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 Sep 05 21:09:06 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:06 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Temporary image 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 is fetched for user bc0d52aae79b491a957bc43f5d1b020f. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:09:06 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:06 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 is being set with open permissions: ugo+rw Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:06 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[3913b3de-53a0-451a-b1e4-1b39486efae4]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:06 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:06 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD Sep 05 21:09:06 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:06 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3" returned: 0 in 0.257s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:06 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.info Sep 05 21:09:06 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:06 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:07 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD Sep 05 21:09:07 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:07 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.info" returned: 0 in 0.258s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:07 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.info is being set with open permissions: ugo+rw Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:07 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.info Sep 05 21:09:07 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:07 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:07 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.info" returned: 0 in 0.273s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.163s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-418263002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5534f84-7b27-4c80-8ac4-01037e116b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:03Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Creating volume c5534f84-7b27-4c80-8ac4-01037e116b5a {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:07 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:07 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a 1073741824 Sep 05 21:09:07 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d6b51cd9-6ac7-4c8c-aa31-4524e71da95b tempest-CreateVolumesFromSnapshotTest-1571911074 None] Create snapshot completed successfully Sep 05 21:09:07 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a 1073741824" returned: 0 in 0.397s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:07 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a Sep 05 21:09:07 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:08 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.424s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078349845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b3390f-9c83-4846-ba54-7e5cd4e299fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dd374747b694348a50787ff122ea703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:04Z,use_quota=True,user_id='7bf6d975863346e0bd35fb63a77d6401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Creating volume 57b3390f-9c83-4846-ba54-7e5cd4e299fd {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:08 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ef69fd-481d-4f25-9332-d532368dd662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5534f84-7b27-4c80-8ac4-01037e116b5a', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd 1073741824 Sep 05 21:09:08 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337429c7-bd23-40e0-b4d8-10fb3d6f7727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Volume volume-c5534f84-7b27-4c80-8ac4-01037e116b5a (c5534f84-7b27-4c80-8ac4-01037e116b5a): created successfully Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337429c7-bd23-40e0-b4d8-10fb3d6f7727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (959df7a2-0830-4ea2-a80e-ac3da5ad24b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:08 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-03990962-846a-45d1-a83d-c8587b1c4fa5 tempest-CreateVolumesFromImageTest-405682178 None] Created volume successfully. Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (77ec5038-1c66-4965-b6ca-8bd51ef20a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26f3a86-f6ba-467d-8f61-e4361bd2a5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26f3a86-f6ba-467d-8f61-e4361bd2a5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745500793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807c09b0-fe9c-4af4-8a87-267a31a1b8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:08Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f386b8a-4410-4b29-9540-0bf3f851375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f386b8a-4410-4b29-9540-0bf3f851375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25c2ed4-b8cf-42df-bd49-a204f8814440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25c2ed4-b8cf-42df-bd49-a204f8814440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807c09b0-fe9c-4af4-8a87-267a31a1b8fa', 'volume_name': 'volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a85c9a3-d667-45d0-a752-21e3626d492d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a85c9a3-d667-45d0-a752-21e3626d492d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fc7620-7c46-42eb-aae0-1f927fbba834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume 807c09b0-fe9c-4af4-8a87-267a31a1b8fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa', 'volume_size': 1} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:08 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd 1073741824" returned: 0 in 0.474s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:08 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd Sep 05 21:09:08 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (89a034b8-03a9-4ac7-9278-b2851cf83aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b82fb9-ee6f-4d93-9bc1-a75c520fac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b82fb9-ee6f-4d93-9bc1-a75c520fac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446573705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a0231-20b8-45bc-a7f0-d7300dfb51fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:09Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b96e9b-e1bd-4de0-b3e2-54d7a650bcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b96e9b-e1bd-4de0-b3e2-54d7a650bcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20224a20-b93f-4735-baab-443c39bd15a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20224a20-b93f-4735-baab-443c39bd15a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962a0231-20b8-45bc-a7f0-d7300dfb51fe', 'volume_name': 'volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82225999-3477-4bbf-a390-b223c679e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82225999-3477-4bbf-a390-b223c679e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8342c877-3de3-4d6a-a9ca-ac4e0efbd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:08 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume 962a0231-20b8-45bc-a7f0-d7300dfb51fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe', 'volume_size': 1} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:08 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd" returned: 0 in 0.279s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.681s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Creating offline snapshot a3b7538f-61e8-4640-b675-c6687922669d of volume 1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:09:08 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de5ab94-c7a5-4afa-9087-4a4a8a0cf5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c86af-4074-4bf8-a4ad-32f368559f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7730000f-f6aa-4af7-8c31-2b6d8adf0fda]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:09 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Volume volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd (57b3390f-9c83-4846-ba54-7e5cd4e299fd): created successfully Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106c86af-4074-4bf8-a4ad-32f368559f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Flow 'volume_create_manager' (2ca31a3c-4093-4c09-943f-415e536faf1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bd632786-1441-4287-9896-29c31e4ec137 tempest-CreateVolumesFromImageTest-405682178 None] Created volume successfully. Sep 05 21:09:09 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb Sep 05 21:09:09 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (ca8e6c6d-3675-4c98-871b-4614d5d1a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c423a8-bbad-46ce-a82b-d5f889effec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-57b3390f-9c83-4846-ba54-7e5cd4e299fd-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c423a8-bbad-46ce-a82b-d5f889effec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222306681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4bc375-1a59-4179-b09e-3e7b1c3020d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:09Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e856b54-3d36-4cba-b1ee-570bddde6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e856b54-3d36-4cba-b1ee-570bddde6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb83a6c-01fd-4734-898a-95372d59c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb83a6c-01fd-4734-898a-95372d59c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4bc375-1a59-4179-b09e-3e7b1c3020d3', 'volume_name': 'volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b128ca-e310-41e8-a4f0-1d8d2811ed2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b128ca-e310-41e8-a4f0-1d8d2811ed2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b178f06a-56d4-4e10-bdac-98a5529c5cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume 8e4bc375-1a59-4179-b09e-3e7b1c3020d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3', 'volume_size': 1} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-57b3390f-9c83-4846-ba54-7e5cd4e299fd-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-quobyte-57b3390f-9c83-4846-ba54-7e5cd4e299fd" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-57b3390f-9c83-4846-ba54-7e5cd4e299fd" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d694f10-163d-408a-ae96-df43fcfed2d3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:09 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd Sep 05 21:09:09 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:09 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb" returned: 0 in 0.600s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:09 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d 1G Sep 05 21:09:09 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (395f2a4d-e2ea-4b79-a4ad-0d2c88db9e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022fac2b-4a98-47d3-9efa-7640d4bcb76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022fac2b-4a98-47d3-9efa-7640d4bcb76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1000573268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce154d43-eff6-4b77-81d8-dbf599849f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:10Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbe0df4-e5f2-43ce-a0cb-90a31bfecbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbe0df4-e5f2-43ce-a0cb-90a31bfecbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d371b9a7-11fa-43b6-852e-9566a1c4d86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d371b9a7-11fa-43b6-852e-9566a1c4d86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce154d43-eff6-4b77-81d8-dbf599849f14', 'volume_name': 'volume-ce154d43-eff6-4b77-81d8-dbf599849f14', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4007781d-b504-430a-83f1-c28d8f093f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4007781d-b504-430a-83f1-c28d8f093f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806d749c-b646-4339-8719-b53c83862ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:09 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume ce154d43-eff6-4b77-81d8-dbf599849f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce154d43-eff6-4b77-81d8-dbf599849f14', 'volume_size': 1} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:09 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd" returned: 0 in 0.440s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:09 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd Sep 05 21:09:09 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (503a7824-3a14-49b8-aa43-c227a6e81f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:10 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f593bb-fba3-48dc-b1ef-9181964fdbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d 1G" returned: 0 in 0.525s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce2d291-e180-4734-83d6-a571760fd4eb -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f593bb-fba3-48dc-b1ef-9181964fdbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127487020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259acb3e-c2c6-4f43-9079-c1811cc3aa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:10Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:10 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce2d291-e180-4734-83d6-a571760fd4eb -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d Sep 05 21:09:10 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:10 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4eb908a-e637-4f17-917b-0174d16ad3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4eb908a-e637-4f17-917b-0174d16ad3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638a68b6-f14e-41ea-8e3e-5a19942eb0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (638a68b6-f14e-41ea-8e3e-5a19942eb0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259acb3e-c2c6-4f43-9079-c1811cc3aa64', 'volume_name': 'volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea3dbd4-f3c9-4e89-a8e5-9886bd26ddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea3dbd4-f3c9-4e89-a8e5-9886bd26ddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e6202b-07c9-41f6-987a-e98e21b3e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:10 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume 259acb3e-c2c6-4f43-9079-c1811cc3aa64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64', 'volume_size': 1} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-57b3390f-9c83-4846-ba54-7e5cd4e299fd" returned: 0 in 0.338s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-57b3390f-9c83-4846-ba54-7e5cd4e299fd" released by "delete_volume" :: held 0.828s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Created reservations ['74942c88-1b88-41fc-8c6b-6cf805a5b55e', '1ac54475-db59-4519-8311-c8da143c3ca8', '3f94c5a9-d540-4378-a06f-338aa0f40053', '0f9ea2ad-6064-46ae-b385-3059f6f15e79'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:10 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:10 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-c5534f84-7b27-4c80-8ac4-01037e116b5a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-c5534f84-7b27-4c80-8ac4-01037e116b5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:10 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-quobyte-c5534f84-7b27-4c80-8ac4-01037e116b5a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ce2d291-e180-4734-83d6-a571760fd4eb -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d" returned: 0 in 0.338s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:10 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d is being set with open permissions: ugo+rw Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-c5534f84-7b27-4c80-8ac4-01037e116b5a" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:10 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d Sep 05 21:09:10 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca04632-8388-4b73-989c-e0fe0f0b0e2b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:10 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.302s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:10 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Deleted volume successfully. Sep 05 21:09:10 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-018ab10e-76bd-4947-993e-601a12a5cc6a tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-57b3390f-9c83-4846-ba54-7e5cd4e299fd-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:10 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:10 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d" returned: 0 in 0.275s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:10 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.info Sep 05 21:09:10 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:10 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a" returned: 0 in 0.391s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:10 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a Sep 05 21:09:10 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:11 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.info" returned: 0 in 0.254s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:11 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.info is being set with open permissions: ugo+rw Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:11 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.info Sep 05 21:09:11 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:11 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5534f84-7b27-4c80-8ac4-01037e116b5a" returned: 0 in 0.251s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-c5534f84-7b27-4c80-8ac4-01037e116b5a" released by "delete_volume" :: held 0.695s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Created reservations ['a24b8439-32e5-4f62-bdff-5d2544ca6c70', '4bad6788-2bc3-47e5-bfbf-294e80cc290a', 'afb057ac-a64a-4661-83eb-1818f8bc3e91', '3549aea6-b1cb-4ea5-a944-41a6976cd68e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:11 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.info" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.957s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7948a8c2-6a79-444e-a24f-3960e01b97b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8a748c10834067aaf09c0944912d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:05Z,use_quota=True,user_id='bc0d52aae79b491a957bc43f5d1b020f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7933c13b-9a30-4ff1-b8e3-d10f02b55132),volume_type_id=7933c13b-9a30-4ff1-b8e3-d10f02b55132)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Creating volume 7948a8c2-6a79-444e-a24f-3960e01b97b3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:11 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:11 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 1073741824 Sep 05 21:09:11 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-483a78f0-0eb8-4948-ba21-89e5ed1c846f tempest-VolumeDependencyTests-500778702 None] Create snapshot completed successfully Sep 05 21:09:11 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:11 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:11 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.291s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Deleted volume successfully. Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-quobyte-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7ed0a291-bdab-46d1-8ab1-4251f6c0fe15 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-c5534f84-7b27-4c80-8ac4-01037e116b5a-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9196e48-1184-4f97-9eec-5d2a47355bb3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:11 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 1073741824" returned: 0 in 0.509s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:11 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e Sep 05 21:09:11 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:11 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 Sep 05 21:09:11 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:12 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:12 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.640s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745500793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807c09b0-fe9c-4af4-8a87-267a31a1b8fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:08Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Creating volume 807c09b0-fe9c-4af4-8a87-267a31a1b8fa {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:12 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e Sep 05 21:09:12 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:12 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:12 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa 1073741824 Sep 05 21:09:12 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Attempting download of 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'metadata': {}}])) to volume 7948a8c2-6a79-444e-a24f-3960e01b97b3. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Flow 'volume_create_manager' (0c82fecf-fcc0-4911-9478-cbaeae197738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a68db0-4618-4840-b541-b94841c431cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9980eca2-ba88-443f-98b4-353893592246]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_rbe3d8ju {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a68db0-4618-4840-b541-b94841c431cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1083512622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1f4b6d-b685-413b-93c0-d5c31eec39ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f122b54aec84b2ebec283ef07c13a4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3b7538f-61e8-4640-b675-c6687922669d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:12Z,use_quota=True,user_id='d72ef6c1d4884eb88f6fd5426b529eb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f18df85-1cfc-4758-ae9f-2dd0a553b20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f18df85-1cfc-4758-ae9f-2dd0a553b20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12c9a8f-a383-41c5-9c38-fa78078ce82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12c9a8f-a383-41c5-9c38-fa78078ce82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e1f4b6d-b685-413b-93c0-d5c31eec39ff', 'volume_name': 'volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff', 'volume_size': 1, 'snapshot_id': 'a3b7538f-61e8-4640-b675-c6687922669d'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95005611-6dde-4a11-a146-c552963386c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95005611-6dde-4a11-a146-c552963386c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82160757-78c7-4259-9d0d-1cacd2cf6698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:12 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Volume 6e1f4b6d-b685-413b-93c0-d5c31eec39ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff', 'volume_size': 1, 'snapshot_id': 'a3b7538f-61e8-4640-b675-c6687922669d'} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:12 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e" returned: 0 in 0.273s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e" released by "delete_volume" :: held 0.774s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:12 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_rbe3d8ju Sep 05 21:09:12 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Created reservations ['f13baebc-f3ba-4993-952b-e933f148bf81', 'bb0f3bef-55aa-4771-8659-891e5c92f60d', '5b60f7bc-68c1-4bef-99d9-4f4444f005d9', '07483dc0-bcc6-4028-b653-caff7070f20e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:12 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:12 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:12 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_rbe3d8ju" returned: 0 in 0.358s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_rbe3d8ju {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:12 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa 1073741824" returned: 0 in 0.529s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:12 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa Sep 05 21:09:12 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-3d99dfff-0f17-4ba1-8153-26ecf864acac-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:12 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_rbe3d8ju Sep 05 21:09:12 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-3d99dfff-0f17-4ba1-8153-26ecf864acac-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:12 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-quobyte-3d99dfff-0f17-4ba1-8153-26ecf864acac" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.349s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:12 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Deleted volume successfully. Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-3d99dfff-0f17-4ba1-8153-26ecf864acac" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-56edf9c5-e9a9-4e12-8be3-7857035f5135 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-dbc4a1f1-4eb4-45f3-a3ee-e90b551ffb9e-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efa986-bc35-4c4a-a85f-2559d107354e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa" returned: 0 in 0.312s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.238s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1446573705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a0231-20b8-45bc-a7f0-d7300dfb51fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:09Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Creating volume 962a0231-20b8-45bc-a7f0-d7300dfb51fe {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:13 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:13 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:13 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_rbe3d8ju" returned: 1 in 0.418s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_rbe3d8ju' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fc7620-7c46-42eb-aae0-1f927fbba834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3786eeb-d8ec-4ece-b136-e66a38214a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:13 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe 1073741824 Sep 05 21:09:13 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[db22c83c-4c5b-43b3-b161-c9f72707835d]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa (807c09b0-fe9c-4af4-8a87-267a31a1b8fa): created successfully Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3786eeb-d8ec-4ece-b136-e66a38214a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (77ec5038-1c66-4965-b6ca-8bd51ef20a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cb25c92e-6a6b-4c3f-9c5e-5ba891480c1d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created volume successfully. Sep 05 21:09:13 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD Sep 05 21:09:13 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:13 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac" returned: 0 in 0.482s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac Sep 05 21:09:13 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:13 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe 1073741824" returned: 0 in 0.549s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD Sep 05 21:09:13 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:13 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe Sep 05 21:09:13 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:13 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3d99dfff-0f17-4ba1-8153-26ecf864acac" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-3d99dfff-0f17-4ba1-8153-26ecf864acac" released by "delete_volume" :: held 0.827s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Created reservations ['3f80e7ef-0e7a-4d22-aee2-26bd59342f77', '9d9e9aca-90d4-4d88-a230-36a1c97db56f', '326d3f69-abff-49b1-b8cc-243d007673f7', 'e176c011-4e6d-463f-9c03-13c5e62e74c2'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:13 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:13 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 was raw, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:13 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.705s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-222306681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4bc375-1a59-4179-b09e-3e7b1c3020d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:09Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Creating volume 8e4bc375-1a59-4179-b09e-3e7b1c3020d3 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:14 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 Sep 05 21:09:14 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-50735427-9d0c-44da-bcf3-8b02e2a085d3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8342c877-3de3-4d6a-a9ca-ac4e0efbd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fabb50e-801f-4788-8296-6af088023714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:14 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 1073741824 Sep 05 21:09:14 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-50735427-9d0c-44da-bcf3-8b02e2a085d3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe (962a0231-20b8-45bc-a7f0-d7300dfb51fe): created successfully Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fabb50e-801f-4788-8296-6af088023714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (89a034b8-03a9-4ac7-9278-b2851cf83aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c627e092-8b0c-43f9-ae56-620b6528382c tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created volume successfully. Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "cinder-quobyte-50735427-9d0c-44da-bcf3-8b02e2a085d3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-50735427-9d0c-44da-bcf3-8b02e2a085d3" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dd7e8f-bd0f-47a2-a97f-7986d66c0afe]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:14 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.329s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Deleted volume successfully. Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f592b2b8-3445-491b-a2ec-259ab049e00d tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-3d99dfff-0f17-4ba1-8153-26ecf864acac-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:14 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 Sep 05 21:09:14 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:14 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3" returned: 0 in 0.563s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_32bd2d5e-7c1d-4a6e-afb0-a804b54599c6_q8wlq1x5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:14 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 1073741824" returned: 0 in 0.546s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:14 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 1G Sep 05 21:09:14 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:14 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 Sep 05 21:09:14 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:14 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3" returned: 0 in 0.421s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:14 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3 Sep 05 21:09:14 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:14 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3" returned: 0 in 0.257s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1000573268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce154d43-eff6-4b77-81d8-dbf599849f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:10Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Creating volume ce154d43-eff6-4b77-81d8-dbf599849f14 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:14 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 1G" returned: 0 in 0.355s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Downloaded image 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'metadata': {}}])) to volume 7948a8c2-6a79-444e-a24f-3960e01b97b3 successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Temporary image 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 for user bc0d52aae79b491a957bc43f5d1b020f is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Marking volume 7948a8c2-6a79-444e-a24f-3960e01b97b3 as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:09:14 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 1073741824 Sep 05 21:09:14 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b178f06a-56d4-4e10-bdac-98a5529c5cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:14 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7019805-2ec4-40b6-b905-0543ec3e5d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-50735427-9d0c-44da-bcf3-8b02e2a085d3" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Copying metadata from image 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 to 7948a8c2-6a79-444e-a24f-3960e01b97b3. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Creating volume glance metadata for volume 7948a8c2-6a79-444e-a24f-3960e01b97b3 backed by image 32bd2d5e-7c1d-4a6e-afb0-a804b54599c6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'caf2bc6ef3af24d0e9cb7cf1e527a46d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-quobyte-50735427-9d0c-44da-bcf3-8b02e2a085d3" released by "delete_volume" :: held 0.755s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 (8e4bc375-1a59-4179-b09e-3e7b1c3020d3): created successfully Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7019805-2ec4-40b6-b905-0543ec3e5d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:14 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (ca8e6c6d-3675-4c98-871b-4614d5d1a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9240b0f0-08a4-483c-9247-16934797fcfa tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created volume successfully. Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Created reservations ['2da9c1d2-b2b8-484d-95a0-ad366acb172e', 'dbd53613-cc1d-4e21-b412-f633ab7e5a8a', 'd2148cee-ab13-4763-ad81-f4e0e931d16b', '73d58aaf-01ba-442e-814d-a7ba3cd368be'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656f7224-af2b-4450-86aa-377fcd891aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7948a8c2-6a79-444e-a24f-3960e01b97b3', 'volume_size': 1, 'image_id': '32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'caf2bc6ef3af24d0e9cb7cf1e527a46d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e8a748c10834067aaf09c0944912d35', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ac799cb8f2356218e5f9f9b8aff65d0d5e13267b7d1cc22a02c753ea631f8f6806c6b004f212e9787244a655afe9a17b3525ea83b4a42d6001e3efd603e10d7', 'id': '32bd2d5e-7c1d-4a6e-afb0-a804b54599c6', 'created_at': datetime.datetime(2026, 9, 5, 19, 9, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/32bd2d5e-7c1d-4a6e-afb0-a804b54599c6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d1b5af-0a96-4967-a603-ad9f60ea727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:15 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Volume volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 (7948a8c2-6a79-444e-a24f-3960e01b97b3): created successfully Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d1b5af-0a96-4967-a603-ad9f60ea727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Flow 'volume_create_manager' (ad260280-cd08-4ca1-bf16-e51a4a056a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4022daa6-797f-495f-97ac-a9c8a3e92956 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Created volume successfully. Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:15 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:15 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:15 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 1073741824" returned: 0 in 0.474s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:15 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.285s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Deleted volume successfully. Sep 05 21:09:15 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 Sep 05 21:09:15 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0413bcb2-b2a2-4dd4-b2f1-78cf5f5e0779 tempest-CreateVolumesFromImageTest-405682178 None] Lock "cinder-50735427-9d0c-44da-bcf3-8b02e2a085d3-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:15 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14" returned: 0 in 0.267s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.473s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2127487020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259acb3e-c2c6-4f43-9079-c1811cc3aa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dcb3d187ece451da90fb91220c5c730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:10Z,use_quota=True,user_id='f1747f97b92044c98bea294d440a1c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Creating volume 259acb3e-c2c6-4f43-9079-c1811cc3aa64 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:15 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:15 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 1073741824 Sep 05 21:09:15 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806d749c-b646-4339-8719-b53c83862ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce154d43-eff6-4b77-81d8-dbf599849f14', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35d2f38-350c-48a0-b8f7-0fe236f7be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:15 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume volume-ce154d43-eff6-4b77-81d8-dbf599849f14 (ce154d43-eff6-4b77-81d8-dbf599849f14): created successfully Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35d2f38-350c-48a0-b8f7-0fe236f7be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (395f2a4d-e2ea-4b79-a4ad-0d2c88db9e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cde896f2-898c-4f7d-9d02-3661cef2d34d tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created volume successfully. Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Acquiring lock "cinder-7948a8c2-6a79-444e-a24f-3960e01b97b3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "cinder-7948a8c2-6a79-444e-a24f-3960e01b97b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Acquiring lock "cinder-quobyte-7948a8c2-6a79-444e-a24f-3960e01b97b3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "cinder-quobyte-7948a8c2-6a79-444e-a24f-3960e01b97b3" acquired by "delete_volume" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec49fc89-3549-4d5b-81a2-5ba7f24e39bd]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:16 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 1073741824" returned: 0 in 0.552s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:16 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 Sep 05 21:09:16 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 Sep 05 21:09:16 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:16 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:16 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64" returned: 0 in 0.349s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.217s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-quobyte-a3b7538f-61e8-4640-b675-c6687922669d-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e6202b-07c9-41f6-987a-e98e21b3e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224f5760-8257-4431-ba9b-b7101ea08d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-a3b7538f-61e8-4640-b675-c6687922669d-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Creating volume 6e1f4b6d-b685-413b-93c0-d5c31eec39ff from snapshot a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-quobyte-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:16 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Volume volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 (259acb3e-c2c6-4f43-9079-c1811cc3aa64): created successfully Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224f5760-8257-4431-ba9b-b7101ea08d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:16 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Flow 'volume_create_manager' (503a7824-3a14-49b8-aa43-c227a6e81f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] snapshot: a3b7538f-61e8-4640-b675-c6687922669d, volume: 6e1f4b6d-b685-413b-93c0-d5c31eec39ff, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3" returned: 0 in 0.604s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:16 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0f220c4e-1b57-45ba-8883-e09c3062f915 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created volume successfully. Sep 05 21:09:16 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3 Sep 05 21:09:16 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[751f4684-2f3e-4f93-97d4-babb63100eb3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-259acb3e-c2c6-4f43-9079-c1811cc3aa64-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:16 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-259acb3e-c2c6-4f43-9079-c1811cc3aa64-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-259acb3e-c2c6-4f43-9079-c1811cc3aa64" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:17 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d Sep 05 21:09:17 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-259acb3e-c2c6-4f43-9079-c1811cc3aa64" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2973eea-8ba0-4d1b-a4eb-39f9bae52d3b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:17 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-7948a8c2-6a79-444e-a24f-3960e01b97b3" returned: 0 in 0.366s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "cinder-quobyte-7948a8c2-6a79-444e-a24f-3960e01b97b3" released by "delete_volume" :: held 1.033s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:17 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 Sep 05 21:09:17 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Created reservations ['d764b27e-ebe6-44f5-a7e8-7bfeffe28319', '339aa8a7-11ae-434f-b9af-7b0b9fb02514', '61864f77-5638-4829-8cec-d11e2d19ef7b', '66132282-cbcb-477c-8466-ab62567de316'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:17 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d" returned: 0 in 0.505s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce2d291-e180-4734-83d6-a571760fd4eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:09:17 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:17 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ebaf5-550f-4d17-9160-b55d2562c246]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:17 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb Sep 05 21:09:17 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:17 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64" returned: 0 in 0.456s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:17 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64 Sep 05 21:09:17 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:17 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.316s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Deleted volume successfully. Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-1e2d4f28-808a-4d7f-aa17-fcf170bb2375 tempest-VolumeAndVolumeTypeFromImageTest-1489017726 None] Lock "cinder-7948a8c2-6a79-444e-a24f-3960e01b97b3-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:17 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb" returned: 0 in 0.429s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:17 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff Sep 05 21:09:17 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:17 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-259acb3e-c2c6-4f43-9079-c1811cc3aa64" returned: 0 in 0.347s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-259acb3e-c2c6-4f43-9079-c1811cc3aa64" released by "delete_volume" :: held 0.860s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:17 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created reservations ['a60647a7-f816-4377-85e6-7c35ab087e26', 'fc7aabe5-7e6b-490e-af5d-24da4de84204', 'fcdd75b0-53b6-40e2-aed4-f36b4f15b5ac', 'f55aab83-8b3b-4193-95cb-c31b2e9a47e2'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:18 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:18 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-ce154d43-eff6-4b77-81d8-dbf599849f14-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-ce154d43-eff6-4b77-81d8-dbf599849f14-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-ce154d43-eff6-4b77-81d8-dbf599849f14" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-ce154d43-eff6-4b77-81d8-dbf599849f14" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362fd28-cc54-4934-87b7-db085ec7ce54]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:18 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 Sep 05 21:09:18 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:18 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.439s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:18 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Deleted volume successfully. Sep 05 21:09:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a7212bd6-689e-4eab-9697-19c79d7fc2b5 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-259acb3e-c2c6-4f43-9079-c1811cc3aa64-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:19 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14" returned: 0 in 0.760s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:19 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14 Sep 05 21:09:19 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:19 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ce154d43-eff6-4b77-81d8-dbf599849f14" returned: 0 in 0.635s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-ce154d43-eff6-4b77-81d8-dbf599849f14" released by "delete_volume" :: held 1.481s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:19 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created reservations ['c8729766-b613-4545-9a19-eac06a34f095', 'b9b42c4d-f2c5-4be5-96d3-9cd26ee8149a', '8350df72-cfbd-455a-bc52-2f05f2947e0d', 'cf448096-6ba3-452e-9774-e87fa8119486'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:19 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Flow 'volume_create_manager' (231164e6-aa45-4f87-94f1-da95bbb48fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5ddd78-2804-409d-b5c4-06d6835a500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5ddd78-2804-409d-b5c4-06d6835a500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c96aac247ff4ad4af3268015387e64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:20Z,use_quota=True,user_id='6105572fbf5349809a405cb567540474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee925b46-3f8f-432e-ae16-9a04c0bc0d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee925b46-3f8f-432e-ae16-9a04c0bc0d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb869b1-de21-4a5f-93d1-2cb3ffd69690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb869b1-de21-4a5f-93d1-2cb3ffd69690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729', 'volume_name': 'volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4940586c-8929-4ce6-9586-468c50b43798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4940586c-8929-4ce6-9586-468c50b43798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766208c5-1fb0-44bd-a6db-87790fc686eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:20 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Volume ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729', 'volume_size': 1} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:20 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:20 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-8e4bc375-1a59-4179-b09e-3e7b1c3020d3-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:20 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-8e4bc375-1a59-4179-b09e-3e7b1c3020d3-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:21 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-8e4bc375-1a59-4179-b09e-3e7b1c3020d3" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.714s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:21 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:21 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Deleted volume successfully. Sep 05 21:09:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-8e4bc375-1a59-4179-b09e-3e7b1c3020d3" acquired by "delete_volume" :: waited 0.073s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-48afc4e0-7946-4ac7-a507-91e46e8728f8 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-ce154d43-eff6-4b77-81d8-dbf599849f14-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:21 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de1f465-6b8a-4b10-ab97-83111dfbf56d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:21 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 Sep 05 21:09:21 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:22 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3" returned: 0 in 1.045s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:22 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:22 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3 Sep 05 21:09:22 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:23 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8e4bc375-1a59-4179-b09e-3e7b1c3020d3" returned: 0 in 1.019s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-8e4bc375-1a59-4179-b09e-3e7b1c3020d3" released by "delete_volume" :: held 2.171s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created reservations ['32eccb51-ddc6-481e-be78-d4a69e8c066d', '7836c496-d4a9-495b-ab3b-1e715c5aaa17', '64a9ed59-b329-431d-8b63-f95548a6f2b5', 'a74d27bd-386a-48df-a694-f3a3e42001d7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:23 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:23 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:23 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" returned: 0 in 6.113s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:09:23 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Converted 1024.00 MB image at 167.42 MB/s Sep 05 21:09:23 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff is being set with open permissions: ugo+rw Sep 05 21:09:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:23 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff Sep 05 21:09:23 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:24 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.478s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Deleted volume successfully. Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-83e6ee38-46a7-4a56-bf5e-1f0ca55c8024 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-8e4bc375-1a59-4179-b09e-3e7b1c3020d3-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" returned: 0 in 0.296s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" released by "_copy_volume_from_snapshot" :: held 7.493s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-962a0231-20b8-45bc-a7f0-d7300dfb51fe-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-962a0231-20b8-45bc-a7f0-d7300dfb51fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-a3b7538f-61e8-4640-b675-c6687922669d-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" released by "_create_volume_from_snapshot" :: held 7.631s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.684s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.112s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c96aac247ff4ad4af3268015387e64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:20Z,use_quota=True,user_id='6105572fbf5349809a405cb567540474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Creating volume ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:24 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:24 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 1073741824 Sep 05 21:09:24 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82160757-78c7-4259-9d0d-1cacd2cf6698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff', 'volume_size': 1, 'snapshot_id': 'a3b7538f-61e8-4640-b675-c6687922669d'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229629d8-3697-4713-a693-e6afe2db5610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-962a0231-20b8-45bc-a7f0-d7300dfb51fe" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:24 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Volume volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff (6e1f4b6d-b685-413b-93c0-d5c31eec39ff): created successfully Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229629d8-3697-4713-a693-e6afe2db5610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Flow 'volume_create_manager' (0c82fecf-fcc0-4911-9478-cbaeae197738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fac01cf0-7f1a-4257-b4c2-155125cb5537 tempest-VolumeDependencyTests-500778702 None] Created volume successfully. Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-962a0231-20b8-45bc-a7f0-d7300dfb51fe" acquired by "delete_volume" :: waited 0.050s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b59256b-6043-4d2e-b65a-4bd61a11a946]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:24 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe Sep 05 21:09:24 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-a3b7538f-61e8-4640-b675-c6687922669d-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-a3b7538f-61e8-4640-b675-c6687922669d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-quobyte-1ce2d291-e180-4734-83d6-a571760fd4eb" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-1ce2d291-e180-4734-83d6-a571760fd4eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-quobyte-a3b7538f-61e8-4640-b675-c6687922669d" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-a3b7538f-61e8-4640-b675-c6687922669d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Deleting offline snapshot a3b7538f-61e8-4640-b675-c6687922669d of volume 1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] snapshot_file for this snap is: volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b46223-fc66-4bce-91e5-4eccdbde884f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:24 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 1073741824" returned: 0 in 0.573s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:24 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d Sep 05 21:09:24 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:24 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 Sep 05 21:09:24 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:25 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe" returned: 0 in 0.507s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:25 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe Sep 05 21:09:25 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:25 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729" returned: 0 in 0.331s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:25 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-962a0231-20b8-45bc-a7f0-d7300dfb51fe" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:25 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766208c5-1fb0-44bd-a6db-87790fc686eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed6d3d0-516d-4a79-84d6-1b7b3b104a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d" returned: 0 in 0.481s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ce2d291-e180-4734-83d6-a571760fd4eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-962a0231-20b8-45bc-a7f0-d7300dfb51fe" released by "delete_volume" :: held 0.882s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d6cc75-b696-4cd7-a0b1-a63cb9a01abd]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:25 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Volume volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 (ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729): created successfully Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed6d3d0-516d-4a79-84d6-1b7b3b104a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Flow 'volume_create_manager' (231164e6-aa45-4f87-94f1-da95bbb48fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-d047fb9b-1617-4f92-ad0b-31c56594a2fa tempest-CinderUnicodeTest-1228589692 None] Created volume successfully. Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created reservations ['8b7d2cfd-4dae-4719-b813-c838f76ebab7', 'ff127527-2006-4eb8-ac11-8c86a84a4caf', '325e2ed3-f287-4f2d-a7b8-0d18c6bc230d', 'e34875be-e7fa-49fa-9d11-ad359f919e41'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:25 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb Sep 05 21:09:25 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:25 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:25 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:25 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:25 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Deleted volume successfully. Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-41fb8407-f41d-4e47-828f-534128dfba0e tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-962a0231-20b8-45bc-a7f0-d7300dfb51fe-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb" returned: 0 in 0.603s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:25 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:25 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d Sep 05 21:09:25 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:26 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d" returned: 0 in 0.420s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:26 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d Sep 05 21:09:26 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:26 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb.a3b7538f-61e8-4640-b675-c6687922669d" returned: 0 in 0.283s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-a3b7538f-61e8-4640-b675-c6687922669d" released by "_delete_snapshot" :: held 1.906s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-1ce2d291-e180-4734-83d6-a571760fd4eb" released by "delete_snapshot" :: held 1.942s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Created reservations ['53924a2b-7636-43d8-9059-a18b03b6f160', '7a773650-49c1-4ca9-9cb5-361b04e8ad46', '69e44362-baa1-4a68-9ef7-577e3ad36214', 'f61abcaf-6552-488b-b001-8ff84b165c33'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-807c09b0-fe9c-4af4-8a87-267a31a1b8fa-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-807c09b0-fe9c-4af4-8a87-267a31a1b8fa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Delete snapshot completed successfully. Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-51c45d24-daaf-4521-a74c-2afef1bcc290 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-a3b7538f-61e8-4640-b675-c6687922669d-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-807c09b0-fe9c-4af4-8a87-267a31a1b8fa" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-807c09b0-fe9c-4af4-8a87-267a31a1b8fa" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-1ce2d291-e180-4734-83d6-a571760fd4eb-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b49218a-a6d5-4ba0-b687-ae83f494d0af]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Lock "cinder-1ce2d291-e180-4734-83d6-a571760fd4eb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Flow 'volume_create_manager' (b221b1c9-2bb7-40eb-b45f-91843f80c56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b2f5c8-4870-4d6a-a0e8-100606f36fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b2f5c8-4870-4d6a-a0e8-100606f36fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916974240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae89fb3f-da88-4f03-a72d-218b1166f3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c96aac247ff4ad4af3268015387e64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:27Z,use_quota=True,user_id='6105572fbf5349809a405cb567540474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65baee63-ba88-4cc5-9400-53afc8cb6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65baee63-ba88-4cc5-9400-53afc8cb6154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68de22f-35e1-45ed-832c-0a9cb7b20f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:27 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa Sep 05 21:09:27 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68de22f-35e1-45ed-832c-0a9cb7b20f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae89fb3f-da88-4f03-a72d-218b1166f3a2', 'volume_name': 'volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab2a8a9-d2f7-49fd-94d4-7f3683bf4db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab2a8a9-d2f7-49fd-94d4-7f3683bf4db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5156e8ff-b687-42c7-a8df-dee1afeb3f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:27 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Volume ae89fb3f-da88-4f03-a72d-218b1166f3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2', 'volume_size': 1} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-916974240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae89fb3f-da88-4f03-a72d-218b1166f3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c96aac247ff4ad4af3268015387e64a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:27Z,use_quota=True,user_id='6105572fbf5349809a405cb567540474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Creating volume ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:27 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-quobyte-1ce2d291-e180-4734-83d6-a571760fd4eb" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-1ce2d291-e180-4734-83d6-a571760fd4eb" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:27 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 1073741824 Sep 05 21:09:27 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ae5c0e-7bb5-49b8-8462-2c7276e2da7a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:27 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb Sep 05 21:09:27 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:27 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa" returned: 0 in 0.386s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:27 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa Sep 05 21:09:27 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:27 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:27 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb" returned: 0 in 0.391s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:27 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-807c09b0-fe9c-4af4-8a87-267a31a1b8fa" returned: 0 in 0.272s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 1073741824" returned: 0 in 0.494s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:27 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb Sep 05 21:09:27 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-807c09b0-fe9c-4af4-8a87-267a31a1b8fa" released by "delete_volume" :: held 0.741s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:27 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 Sep 05 21:09:27 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created reservations ['2d54f579-f86d-4eb1-8ee5-79f635bb1d20', '5c591013-f3a8-47b1-bc3f-7a6146c5b481', '8c668838-0dc8-44c3-8129-311f183644f0', '9bff0b0f-b91f-4f1a-a575-b5c1b5429742'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:27 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:27 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:27 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1ce2d291-e180-4734-83d6-a571760fd4eb" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-1ce2d291-e180-4734-83d6-a571760fd4eb" released by "delete_volume" :: held 0.761s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-e2d024be-4937-4e1b-b263-0016dbad06a3-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:28 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-e2d024be-4937-4e1b-b263-0016dbad06a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-26c1c5c8-c727-4581-b1a9-bba29836dc30" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5156e8ff-b687-42c7-a8df-dee1afeb3f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0195ae01-9ec0-4dc2-91fb-b8f3be2c7fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-26c1c5c8-c727-4581-b1a9-bba29836dc30" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-e2d024be-4937-4e1b-b263-0016dbad06a3" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:28 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Volume volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 (ae89fb3f-da88-4f03-a72d-218b1166f3a2): created successfully Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0195ae01-9ec0-4dc2-91fb-b8f3be2c7fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Flow 'volume_create_manager' (b221b1c9-2bb7-40eb-b45f-91843f80c56b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Created reservations ['ef1adb51-ec36-40a6-ad06-f53ee5454ad8', '5ce69635-e23a-4a23-8e38-edb30732855e', '0971f37b-eb00-43ef-b2d1-e0f3ee239761', '8ecc9265-c6d0-444a-9494-48cc5e4fdf44'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-90b04da7-1ac4-4d14-9441-312f018fd163 tempest-CinderUnicodeTest-1228589692 None] Created volume successfully. Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-e2d024be-4937-4e1b-b263-0016dbad06a3" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Deleting offline snapshot e2d024be-4937-4e1b-b263-0016dbad06a3 of volume 26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] snapshot_file for this snap is: volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:09:28 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d031cf-1e9b-4e37-beee-be92ce1b06e5]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.392s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Deleted volume successfully. Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-fac8f911-336a-442f-9186-96ad15ca5b3a tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-807c09b0-fe9c-4af4-8a87-267a31a1b8fa-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:28 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:28 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:28 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 Sep 05 21:09:28 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:28 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.278s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Deleted volume successfully. Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8f5bcdf7-bca2-4a1c-8b25-9a09d9478b6d tempest-VolumeDependencyTests-500778702 None] Lock "cinder-1ce2d291-e180-4734-83d6-a571760fd4eb-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:28 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3" returned: 0 in 0.441s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26c1c5c8-c727-4581-b1a9-bba29836dc30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d540a60-2fb2-46a2-b65b-48e238668991]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:28 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 Sep 05 21:09:28 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:29 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:29 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 Sep 05 21:09:29 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-6e1f4b6d-b685-413b-93c0-d5c31eec39ff-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-6e1f4b6d-b685-413b-93c0-d5c31eec39ff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Creating offline snapshot 7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed of volume ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "cinder-quobyte-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7e3da0-86ab-4093-bd43-099c9f830edc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f83c98-b710-4078-9ea5-93dc3c4216c3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:29 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 Sep 05 21:09:29 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:29 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3" returned: 0 in 0.394s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:29 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff Sep 05 21:09:29 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:29 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3 Sep 05 21:09:29 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:29 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2" returned: 0 in 0.392s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:29 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed 1G Sep 05 21:09:29 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:29 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" returned: 0 in 0.377s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:29 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30.e2d024be-4937-4e1b-b263-0016dbad06a3" returned: 0 in 0.285s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:29 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff Sep 05 21:09:29 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-e2d024be-4937-4e1b-b263-0016dbad06a3" released by "_delete_snapshot" :: held 1.620s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-26c1c5c8-c727-4581-b1a9-bba29836dc30" released by "delete_snapshot" :: held 1.682s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:29 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created reservations ['3fa35d55-ef26-4b83-8829-6bd7a9ad4afe', '4e0a8709-6fa5-4b8c-8fc2-73099ea3769c', '8602012a-121a-45ab-860c-ddcb6af0d2b5', '1b3a0246-3588-49ad-9909-064f72a22761'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Delete snapshot completed successfully. Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7e842d58-5999-49a4-a3d5-52363ff3e3a7 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-e2d024be-4937-4e1b-b263-0016dbad06a3-delete_snapshot" released by "delete_snapshot" :: held 1.907s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:30 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" returned: 0 in 0.308s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-quobyte-6e1f4b6d-b685-413b-93c0-d5c31eec39ff" released by "delete_volume" :: held 0.732s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Created reservations ['d695ae02-6f2c-4ea2-b30a-f0c8cbc12d89', '8118c9ff-7cde-4012-839c-7889286146f5', 'b5a9df51-5d6d-42f2-a632-93b69e1ab9af', 'afa5054b-3142-4c77-90ce-a2d18f428b23'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:30 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed 1G" returned: 0 in 0.465s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:30 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed Sep 05 21:09:30 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-26c1c5c8-c727-4581-b1a9-bba29836dc30-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-26c1c5c8-c727-4581-b1a9-bba29836dc30-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:30 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:30 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "cinder-quobyte-26c1c5c8-c727-4581-b1a9-bba29836dc30" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-26c1c5c8-c727-4581-b1a9-bba29836dc30" acquired by "delete_volume" :: waited 0.036s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd7fd93-29d3-4f0b-a263-5a9f0d4f3caa]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:30 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 Sep 05 21:09:30 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:30 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" returned: 0 in 0.509s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:30 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed is being set with open permissions: ugo+rw Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:30 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.423s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:30 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed Sep 05 21:09:30 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Deleted volume successfully. Sep 05 21:09:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0a163c40-a4ec-438f-9b41-062dce52bf19 tempest-VolumeDependencyTests-500778702 None] Lock "cinder-6e1f4b6d-b685-413b-93c0-d5c31eec39ff-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:31 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" returned: 0 in 0.335s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:31 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30" returned: 0 in 0.550s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:31 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30 Sep 05 21:09:31 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:31 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.info Sep 05 21:09:31 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:31 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-26c1c5c8-c727-4581-b1a9-bba29836dc30" returned: 0 in 0.281s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-quobyte-26c1c5c8-c727-4581-b1a9-bba29836dc30" released by "delete_volume" :: held 0.935s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:31 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.info" returned: 0 in 0.332s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:31 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.info is being set with open permissions: ugo+rw Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:31 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.info Sep 05 21:09:31 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Created reservations ['ae0b6800-3958-42fc-a35c-a41fd79b7ebe', 'd2b21c97-5b7d-46ff-9278-030bbc51b301', 'f15d4a7d-05ea-48af-a71f-e4321787f429', '71b854f9-07f9-4b08-ac29-9935401b96d7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:31 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:31 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:31 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.info" returned: 0 in 0.275s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-93313a9a-1b97-4917-9c5d-53141b5fff4b tempest-CinderUnicodeTest-1228589692 None] Create snapshot completed successfully Sep 05 21:09:31 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.266s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:31 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Deleted volume successfully. Sep 05 21:09:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ada3f147-77df-4fd0-b8c6-633aea6f74b9 tempest-CreateVolumesFromSnapshotTest-1571911074 None] Lock "cinder-26c1c5c8-c727-4581-b1a9-bba29836dc30-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "cinder-7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "cinder-quobyte-ae89fb3f-da88-4f03-a72d-218b1166f3a2" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-ae89fb3f-da88-4f03-a72d-218b1166f3a2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "cinder-quobyte-7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Deleting offline snapshot 7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed of volume ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] snapshot_file for this snap is: volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d31d7e4-8363-4944-b8ed-a1372b352f20]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:32 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed Sep 05 21:09:32 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:33 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" returned: 0 in 0.424s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:33 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:09:33 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8603f8fe-e3b1-4fce-b858-35433f76cb66]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:33 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 Sep 05 21:09:33 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:33 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2" returned: 0 in 0.526s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:33 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed Sep 05 21:09:33 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:34 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" returned: 0 in 0.443s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:34 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed Sep 05 21:09:34 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:34 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2.7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" returned: 0 in 0.332s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed" released by "_delete_snapshot" :: held 1.870s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-ae89fb3f-da88-4f03-a72d-218b1166f3a2" released by "delete_snapshot" :: held 1.898s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Created reservations ['6f7b5686-3c83-4eef-9741-e929025a9d69', 'f6d2ad6f-19ea-43fa-bf49-6d7b30c9cc25', '7ab3e49b-2904-48c6-9d39-8a82a645f752', 'f5e08efe-425c-475f-a7c0-508e01d23c7d'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:34 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Delete snapshot completed successfully. Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a517d41e-f4e0-4e1c-88be-49b375cc24c9 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-7f1c7a52-cc9c-4815-a5c9-ac52dc7552ed-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "cinder-ae89fb3f-da88-4f03-a72d-218b1166f3a2-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-ae89fb3f-da88-4f03-a72d-218b1166f3a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "cinder-quobyte-ae89fb3f-da88-4f03-a72d-218b1166f3a2" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-ae89fb3f-da88-4f03-a72d-218b1166f3a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced74dc-b3c9-409c-9115-0949f552df91]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:35 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 Sep 05 21:09:35 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (d836bc4b-4ad5-41f3-bf3e-cee8a31392f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38e0d8-988a-4332-ba63-a8445c446d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38e0d8-988a-4332-ba63-a8445c446d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376839059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abae218-86ed-47bb-8057-b0405a853c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:35Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c5be1b-be5b-4568-aee6-d3d083552c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c5be1b-be5b-4568-aee6-d3d083552c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a16600-9f67-45f5-9bc4-e5c6c7406dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a16600-9f67-45f5-9bc4-e5c6c7406dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1abae218-86ed-47bb-8057-b0405a853c9d', 'volume_name': 'volume-1abae218-86ed-47bb-8057-b0405a853c9d', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832e6a21-caad-405f-9c92-42fd219bd25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832e6a21-caad-405f-9c92-42fd219bd25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:35 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c88f9ea-442b-40f8-bf8b-cee81639c9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:35 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Volume 1abae218-86ed-47bb-8057-b0405a853c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1abae218-86ed-47bb-8057-b0405a853c9d', 'volume_size': 1} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376839059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abae218-86ed-47bb-8057-b0405a853c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:35Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Creating volume 1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:35 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2" returned: 0 in 0.562s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:35 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d 1073741824 Sep 05 21:09:35 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:35 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2 Sep 05 21:09:35 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:35 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ae89fb3f-da88-4f03-a72d-218b1166f3a2" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-ae89fb3f-da88-4f03-a72d-218b1166f3a2" released by "delete_volume" :: held 0.948s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:35 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Created reservations ['c8678d93-abb9-488c-a4b7-ad64d96b07e6', '67afdb5e-9398-4be3-afb1-18d8bb301d3a', 'c183b8db-1a69-4119-a531-e920f949d46e', '22e3b6e0-d3a3-47dd-9ffd-6ded961fdec7'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:36 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d 1073741824" returned: 0 in 0.534s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:36 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:36 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:36 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d Sep 05 21:09:36 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:36 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:36 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c88f9ea-442b-40f8-bf8b-cee81639c9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abae218-86ed-47bb-8057-b0405a853c9d', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d725a67-2731-4669-a7a6-3cba7028e719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.378s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Deleted volume successfully. Sep 05 21:09:36 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Volume volume-1abae218-86ed-47bb-8057-b0405a853c9d (1abae218-86ed-47bb-8057-b0405a853c9d): created successfully Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d725a67-2731-4669-a7a6-3cba7028e719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (d836bc4b-4ad5-41f3-bf3e-cee8a31392f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-afeacf4b-ac59-4d5f-9954-6c7a5f0fc620 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-ae89fb3f-da88-4f03-a72d-218b1166f3a2-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8c9fb409-f01e-4a57-8b0e-60a4e5e2be26 tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (42cd90a2-6b70-4393-ad37-188571597051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffc875d-e851-4718-9cde-9f2c365b08f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffc875d-e851-4718-9cde-9f2c365b08f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480575422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9546fec6-a446-4280-98e0-b6ca33302102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:37Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbcb534-1e41-4efe-bd1d-bcd45527ac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbcb534-1e41-4efe-bd1d-bcd45527ac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce1d7a1-65c6-4573-9083-8b3a17832b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce1d7a1-65c6-4573-9083-8b3a17832b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9546fec6-a446-4280-98e0-b6ca33302102', 'volume_name': 'volume-9546fec6-a446-4280-98e0-b6ca33302102', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b940c7-a64c-452f-b46b-ab0d214f71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b940c7-a64c-452f-b46b-ab0d214f71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cf3e20-7533-4676-8485-1d24fe595f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:36 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume 9546fec6-a446-4280-98e0-b6ca33302102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9546fec6-a446-4280-98e0-b6ca33302102', 'volume_size': 1} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-480575422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9546fec6-a446-4280-98e0-b6ca33302102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:37Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Creating volume 9546fec6-a446-4280-98e0-b6ca33302102 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:36 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:36 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 1073741824 Sep 05 21:09:36 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "cinder-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "cinder-quobyte-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7434dd2-ec6b-4d6a-8237-ac0cea04b4fb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:37 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 Sep 05 21:09:37 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:37 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 1073741824" returned: 0 in 0.561s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:37 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 Sep 05 21:09:37 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:37 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729" returned: 0 in 0.444s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:37 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729 Sep 05 21:09:37 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:37 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102" returned: 0 in 0.346s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cf3e20-7533-4676-8485-1d24fe595f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9546fec6-a446-4280-98e0-b6ca33302102', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec79d0e-ef97-4cbf-a6cc-c537c2104f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:37 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume volume-9546fec6-a446-4280-98e0-b6ca33302102 (9546fec6-a446-4280-98e0-b6ca33302102): created successfully Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec79d0e-ef97-4cbf-a6cc-c537c2104f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (42cd90a2-6b70-4393-ad37-188571597051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:37 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-147d2271-4b9a-4c2e-a543-8b8620bf9041 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created volume successfully. Sep 05 21:09:37 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729" returned: 0 in 0.331s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 of volume 1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:09:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-quobyte-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729" released by "delete_volume" :: held 0.835s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac0518-0ae5-4d48-8760-654123229583]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Created reservations ['3bc72bb3-8908-450d-b6c1-2fd8e3978ea1', '898362eb-4215-4f22-963f-e026a18229dc', 'b1cdc534-716c-4ea5-b7f5-9e2c00338e42', '85f89c2c-abf7-4d52-b603-831be0f3a5a4'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:38 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d Sep 05 21:09:38 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:38 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:38 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:38 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d" returned: 0 in 0.419s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:38 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 1G Sep 05 21:09:38 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:38 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.315s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:38 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Deleted volume successfully. Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-50b1cdd7-4be8-4432-9882-4af10b87f155 tempest-CinderUnicodeTest-1228589692 None] Lock "cinder-ed52cdc5-9fe0-4fed-8d44-e8e8e1a59729-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:38 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 1G" returned: 0 in 0.467s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abae218-86ed-47bb-8057-b0405a853c9d -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:38 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abae218-86ed-47bb-8057-b0405a853c9d -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 Sep 05 21:09:38 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:39 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abae218-86ed-47bb-8057-b0405a853c9d -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" returned: 0 in 0.420s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:39 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 is being set with open permissions: ugo+rw Sep 05 21:09:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:39 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 Sep 05 21:09:39 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:39 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" returned: 0 in 0.316s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:39 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.info Sep 05 21:09:39 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:39 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (f4b9b3cb-d36e-41f1-abd8-a4c90eecf8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb88d1c9-9b7e-427f-98c6-709632bb029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb88d1c9-9b7e-427f-98c6-709632bb029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531529240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48938fa8-3193-4242-844c-82b8e9024ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:40Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2eb4cd-0caf-43d9-8871-7dc4d76aebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2eb4cd-0caf-43d9-8871-7dc4d76aebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cff164e-6b68-4ca3-bc66-fc750d43db92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cff164e-6b68-4ca3-bc66-fc750d43db92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48938fa8-3193-4242-844c-82b8e9024ba7', 'volume_name': 'volume-48938fa8-3193-4242-844c-82b8e9024ba7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334d532b-92d9-4216-b798-9ec06fc5bf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334d532b-92d9-4216-b798-9ec06fc5bf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfdd2ae-c6ba-4c13-b7bc-83ada7d0a1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume 48938fa8-3193-4242-844c-82b8e9024ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48938fa8-3193-4242-844c-82b8e9024ba7', 'volume_size': 1} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.info" returned: 0 in 0.495s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:40 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.info is being set with open permissions: ugo+rw Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:40 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.info Sep 05 21:09:40 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (39248442-53bd-4cf4-a70e-d7358f643679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1e836b-7104-43ad-b0c9-438f7f649dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1e836b-7104-43ad-b0c9-438f7f649dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562094896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504f50b6-7ccb-4ab9-adfa-e0e5a249c81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:40Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd2ed19-632d-4650-a6e4-7b0a6168a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd2ed19-632d-4650-a6e4-7b0a6168a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4053f440-eea1-4b3f-8517-9722a854c195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4053f440-eea1-4b3f-8517-9722a854c195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504f50b6-7ccb-4ab9-adfa-e0e5a249c81d', 'volume_name': 'volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a796efd3-25bc-4736-8a1d-3302f5878815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a796efd3-25bc-4736-8a1d-3302f5878815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b60020-c370-4271-a59e-56d134fd7989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume 504f50b6-7ccb-4ab9-adfa-e0e5a249c81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d', 'volume_size': 1} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:40 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.info" returned: 0 in 0.371s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1531529240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48938fa8-3193-4242-844c-82b8e9024ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:40Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Creating volume 48938fa8-3193-4242-844c-82b8e9024ba7 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:40 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:40 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 1073741824 Sep 05 21:09:40 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9e6ba304-b57b-45e3-a0af-1f584d88eb83 tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (277e2e5a-1066-4221-a1d4-07f82f14ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b20ed5b-7a63-4bd0-90de-6b924a590e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b20ed5b-7a63-4bd0-90de-6b924a590e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891775985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9637c85e-dede-444b-a9a6-f47c61f244e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:41Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efabfe1-4f42-4719-b91d-7adfac802206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:40 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efabfe1-4f42-4719-b91d-7adfac802206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e2c084-1d26-4830-9a06-5ac99c79bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e2c084-1d26-4830-9a06-5ac99c79bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9637c85e-dede-444b-a9a6-f47c61f244e4', 'volume_name': 'volume-9637c85e-dede-444b-a9a6-f47c61f244e4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2848db-7983-481f-9310-80fba086d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2848db-7983-481f-9310-80fba086d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ab64ff-14d2-41b1-b745-00c3c0877c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume 9637c85e-dede-444b-a9a6-f47c61f244e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9637c85e-dede-444b-a9a6-f47c61f244e4', 'volume_size': 1} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.138s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-1abae218-86ed-47bb-8057-b0405a853c9d" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1abae218-86ed-47bb-8057-b0405a853c9d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 of volume 1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ff428f-4060-497e-93b3-68da27138146]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:41 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 1073741824" returned: 0 in 0.820s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:41 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 Sep 05 21:09:41 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:41 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 Sep 05 21:09:41 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (6d9d9f08-f4d3-426c-9037-75b870bc1582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43284c1-51b1-4a9b-8dcc-bd47b6856513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43284c1-51b1-4a9b-8dcc-bd47b6856513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1474520253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8105c4-148e-4b48-9580-3639ddf55673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:42Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08aa60c-3f91-48fb-9431-aa66a15da3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08aa60c-3f91-48fb-9431-aa66a15da3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf98d29-84a8-42dd-919c-e6edd2840e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf98d29-84a8-42dd-919c-e6edd2840e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8105c4-148e-4b48-9580-3639ddf55673', 'volume_name': 'volume-3f8105c4-148e-4b48-9580-3639ddf55673', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9351ea1-7be3-4410-8f5b-49b58c1dc640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9351ea1-7be3-4410-8f5b-49b58c1dc640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7afc874-ad54-453c-ad60-1115a2ddcc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume 3f8105c4-148e-4b48-9580-3639ddf55673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8105c4-148e-4b48-9580-3639ddf55673', 'volume_size': 1} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:41 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7" returned: 0 in 0.457s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562094896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504f50b6-7ccb-4ab9-adfa-e0e5a249c81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:40Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Creating volume 504f50b6-7ccb-4ab9-adfa-e0e5a249c81d {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:41 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecfdd2ae-c6ba-4c13-b7bc-83ada7d0a1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48938fa8-3193-4242-844c-82b8e9024ba7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:42 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2f291f-a314-4a32-a6a1-c5e118f3e09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" returned: 0 in 0.612s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abae218-86ed-47bb-8057-b0405a853c9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:09:42 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d 1073741824 Sep 05 21:09:42 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:42 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume volume-48938fa8-3193-4242-844c-82b8e9024ba7 (48938fa8-3193-4242-844c-82b8e9024ba7): created successfully Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2f291f-a314-4a32-a6a1-c5e118f3e09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (f4b9b3cb-d36e-41f1-abd8-a4c90eecf8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea1c3a4-eb1f-4409-8a04-d785fc18becd]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3c420e59-71cd-4a2b-8cc2-780f76b64075 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created volume successfully. Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (57cb2ace-a405-43a5-9ee9-929f4769ba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eb9d94-64cf-47ef-bf24-8212aaa3c030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69eb9d94-64cf-47ef-bf24-8212aaa3c030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789628227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda61fa0-b867-4168-8493-0bfd24fac5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:42Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7456fc2-b8de-4813-8637-c4debcd1b2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7456fc2-b8de-4813-8637-c4debcd1b2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c62db9-a163-4728-9cb9-34b8313fdcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c62db9-a163-4728-9cb9-34b8313fdcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda61fa0-b867-4168-8493-0bfd24fac5d6', 'volume_name': 'volume-cda61fa0-b867-4168-8493-0bfd24fac5d6', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c1c681-d18f-4c96-adaa-bb3c4f1b40e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c1c681-d18f-4c96-adaa-bb3c4f1b40e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1c97af-2188-4559-a25a-367cf630cb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:42 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume cda61fa0-b867-4168-8493-0bfd24fac5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda61fa0-b867-4168-8493-0bfd24fac5d6', 'volume_size': 1} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:42 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d Sep 05 21:09:42 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:42 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d" returned: 0 in 0.511s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:42 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 Sep 05 21:09:42 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:42 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d 1073741824" returned: 0 in 0.664s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:42 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d Sep 05 21:09:42 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:43 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.987s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1891775985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9637c85e-dede-444b-a9a6-f47c61f244e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:41Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Creating volume 9637c85e-dede-444b-a9a6-f47c61f244e4 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:43 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:43 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" returned: 0 in 0.470s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:43 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 1073741824 Sep 05 21:09:43 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b60020-c370-4271-a59e-56d134fd7989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:43 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61 Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a3c9c9-c8ed-4426-b6d9-e3ad3082a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:43 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:43 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d (504f50b6-7ccb-4ab9-adfa-e0e5a249c81d): created successfully Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a3c9c9-c8ed-4426-b6d9-e3ad3082a986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (39248442-53bd-4cf4-a70e-d7358f643679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f9732746-5e62-4246-ac4c-f154fed34918 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created volume successfully. Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-51a76209-b41a-4114-b161-b41e30211da8 tempest-ProjectAdminTests-1508527719 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.656494140625, 'free_capacity_gb': 1773.656494140625, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87778) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 05 21:09:43 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d.891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" returned: 0 in 0.509s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61" released by "_delete_snapshot" :: held 2.283s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1abae218-86ed-47bb-8057-b0405a853c9d" released by "delete_snapshot" :: held 2.318s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Created reservations ['8d774387-d2f2-4c48-98cd-83486477932f', 'c8c69c5a-b882-4a41-b0a0-222d1df4fa8b', '97fc5b1d-b511-45f9-9e75-0e149cc62806', '30e6727a-5b7a-4ba3-ba41-24adc4db5fd3'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:43 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 1073741824" returned: 0 in 0.747s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7c708654-fed4-44b4-9095-ce25ce0f6020 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-891bc2a0-dc4d-4d09-8f3b-ef0f20ea0a61-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:43 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 Sep 05 21:09:43 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:44 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.409s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1474520253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8105c4-148e-4b48-9580-3639ddf55673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:42Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Creating volume 3f8105c4-148e-4b48-9580-3639ddf55673 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:44 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ab64ff-14d2-41b1-b745-00c3c0877c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9637c85e-dede-444b-a9a6-f47c61f244e4', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:44 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 1073741824 Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dbad39-0112-4541-862b-5a35d7776930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:44 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:44 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume volume-9637c85e-dede-444b-a9a6-f47c61f244e4 (9637c85e-dede-444b-a9a6-f47c61f244e4): created successfully Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dbad39-0112-4541-862b-5a35d7776930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (277e2e5a-1066-4221-a1d4-07f82f14ea15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:44 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b42bcc8a-9d26-4f8e-a23a-1ff5102b47bc tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created volume successfully. Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-1abae218-86ed-47bb-8057-b0405a853c9d-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Lock "cinder-1abae218-86ed-47bb-8057-b0405a853c9d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-1abae218-86ed-47bb-8057-b0405a853c9d" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1abae218-86ed-47bb-8057-b0405a853c9d" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58e661-1361-4b06-a47a-1d5b9ac96faa]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:44 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 1073741824" returned: 0 in 0.683s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:44 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d Sep 05 21:09:44 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:44 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 Sep 05 21:09:44 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:45 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d" returned: 0 in 0.483s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:45 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d Sep 05 21:09:45 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:45 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673" returned: 0 in 0.365s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-789628227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda61fa0-b867-4168-8493-0bfd24fac5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc91194dbf0645cc9131d482af6e73c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:42Z,use_quota=True,user_id='7ea934e9237348c4a5f46772e0d95251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Creating volume cda61fa0-b867-4168-8493-0bfd24fac5d6 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:45 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7afc874-ad54-453c-ad60-1115a2ddcc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8105c4-148e-4b48-9580-3639ddf55673', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ab65fc-a6b3-4918-9781-aacd54f7bf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:45 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 1073741824 Sep 05 21:09:45 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:45 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume volume-3f8105c4-148e-4b48-9580-3639ddf55673 (3f8105c4-148e-4b48-9580-3639ddf55673): created successfully Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ab65fc-a6b3-4918-9781-aacd54f7bf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (6d9d9f08-f4d3-426c-9037-75b870bc1582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-94c955b4-1f53-4d86-921a-f2bb850c1ab1 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created volume successfully. Sep 05 21:09:45 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1abae218-86ed-47bb-8057-b0405a853c9d" returned: 0 in 0.335s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1abae218-86ed-47bb-8057-b0405a853c9d" released by "delete_volume" :: held 0.908s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Created reservations ['0fb6cd2f-0b8a-430e-ba79-4d52d0cffa92', 'b3820324-a2ef-46ad-9bc1-927625913c0e', '4dc1fe23-b8a0-4192-aa28-283f1265cdf1', 'db24c334-61d1-412b-aa22-cfc274811137'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:45 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:45 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:45 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 1073741824" returned: 0 in 0.660s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:46 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 Sep 05 21:09:46 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:46 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8774e202-067d-4614-a2aa-a7df1c02568c tempest-ProjectMemberTests-1286767482 None] Lock "cinder-1abae218-86ed-47bb-8057-b0405a853c9d-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:46 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6" returned: 0 in 0.280s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1c97af-2188-4559-a25a-367cf630cb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda61fa0-b867-4168-8493-0bfd24fac5d6', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea87742-1179-4129-bbdd-3281d90fa8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Volume volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 (cda61fa0-b867-4168-8493-0bfd24fac5d6): created successfully Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea87742-1179-4129-bbdd-3281d90fa8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Flow 'volume_create_manager' (57cb2ace-a405-43a5-9ee9-929f4769ba07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:46 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a3f3edae-4a1f-403c-8b3e-58389ee17cc5 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created volume successfully. Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-cda61fa0-b867-4168-8493-0bfd24fac5d6-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-cda61fa0-b867-4168-8493-0bfd24fac5d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-quobyte-cda61fa0-b867-4168-8493-0bfd24fac5d6" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-cda61fa0-b867-4168-8493-0bfd24fac5d6" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeb9c67-1bc8-443e-96c3-3869a0fd47d5]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:47 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 Sep 05 21:09:47 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (d332bf41-f820-4c3e-80fb-12b9af76a7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ea40c4-7bac-4968-be8b-560232609618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ea40c4-7bac-4968-be8b-560232609618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393256856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3105906a-c7b7-4a61-8be7-330af19ac7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:47Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae9f287-c6e8-4749-ab59-6c3363349a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae9f287-c6e8-4749-ab59-6c3363349a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cf93ea-3b06-4ea7-8ee0-7ff1fdbc58f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cf93ea-3b06-4ea7-8ee0-7ff1fdbc58f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3105906a-c7b7-4a61-8be7-330af19ac7ef', 'volume_name': 'volume-3105906a-c7b7-4a61-8be7-330af19ac7ef', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bfc442-9347-4a96-a1d1-dfd0a16dd8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bfc442-9347-4a96-a1d1-dfd0a16dd8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:47 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85482173-d229-4009-9587-d32cf3605615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Volume 3105906a-c7b7-4a61-8be7-330af19ac7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3105906a-c7b7-4a61-8be7-330af19ac7ef', 'volume_size': 1} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393256856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3105906a-c7b7-4a61-8be7-330af19ac7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:47Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Creating volume 3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:47 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6" returned: 0 in 0.530s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:47 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef 1073741824 Sep 05 21:09:47 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:47 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6 Sep 05 21:09:47 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-cda61fa0-b867-4168-8493-0bfd24fac5d6" returned: 0 in 0.364s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:47 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:47 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-cda61fa0-b867-4168-8493-0bfd24fac5d6" released by "delete_volume" :: held 0.962s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created reservations ['86fe4033-1628-41c0-94a0-2b4779b88a66', 'c5649cf8-b3ec-44f0-b5e8-32378de03297', '8f25276d-3bb5-46aa-8f98-07281a85fc00', '610d36e9-a014-46a9-a330-12638ee6d6c9'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:48 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef 1073741824" returned: 0 in 0.614s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:48 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:48 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:48 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef Sep 05 21:09:48 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:48 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.294s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Deleted volume successfully. Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b61c9524-069a-48b4-9c29-3f9173566ec7 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-cda61fa0-b867-4168-8493-0bfd24fac5d6-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:48 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef" returned: 0 in 0.311s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85482173-d229-4009-9587-d32cf3605615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3105906a-c7b7-4a61-8be7-330af19ac7ef', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d98a5f-8d78-40a6-b965-d6e7c64ac7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:48 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Volume volume-3105906a-c7b7-4a61-8be7-330af19ac7ef (3105906a-c7b7-4a61-8be7-330af19ac7ef): created successfully Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d98a5f-8d78-40a6-b965-d6e7c64ac7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:48 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (d332bf41-f820-4c3e-80fb-12b9af76a7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0105f4ac-f814-4223-97e4-c3ac06d01226 tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-3f8105c4-148e-4b48-9580-3639ddf55673-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-3f8105c4-148e-4b48-9580-3639ddf55673-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-quobyte-3f8105c4-148e-4b48-9580-3639ddf55673" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-3f8105c4-148e-4b48-9580-3639ddf55673" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a627810b-f2ee-4527-87c5-3a81f2d98267]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:49 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 Sep 05 21:09:49 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 of volume 3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b16347-0e4d-4a77-882c-2ad81943d5f1]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:50 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673" returned: 0 in 0.563s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:50 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673 Sep 05 21:09:50 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:50 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef Sep 05 21:09:50 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:50 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3f8105c4-148e-4b48-9580-3639ddf55673" returned: 0 in 0.342s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-3f8105c4-148e-4b48-9580-3639ddf55673" released by "delete_volume" :: held 0.978s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:50 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef" returned: 0 in 0.522s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:50 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 1G Sep 05 21:09:50 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created reservations ['f2cb2700-68a7-4480-ac49-4a178f61e1a7', '59153fcb-c1f3-4ff4-a6cc-2b4c5c101efc', '9c58498c-31f5-47c8-9a91-04619df6ddd3', 'c22813e4-7699-4be5-913f-a958d6c08d31'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:50 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:50 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:50 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.322s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Deleted volume successfully. Sep 05 21:09:50 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 1G" returned: 0 in 0.542s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3105906a-c7b7-4a61-8be7-330af19ac7ef -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-9f4496ed-89dd-4514-bd8d-3063c5da81ba tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-3f8105c4-148e-4b48-9580-3639ddf55673-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:50 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3105906a-c7b7-4a61-8be7-330af19ac7ef -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 Sep 05 21:09:50 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:51 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3105906a-c7b7-4a61-8be7-330af19ac7ef -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:51 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 is being set with open permissions: ugo+rw Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:51 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 Sep 05 21:09:51 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:51 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" returned: 0 in 0.300s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-9637c85e-dede-444b-a9a6-f47c61f244e4-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-9637c85e-dede-444b-a9a6-f47c61f244e4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:51 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.info Sep 05 21:09:51 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-quobyte-9637c85e-dede-444b-a9a6-f47c61f244e4" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-9637c85e-dede-444b-a9a6-f47c61f244e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9bc4bc-c606-47f6-875d-978895e6435c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:51 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 Sep 05 21:09:51 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:52 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.info" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:52 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.info is being set with open permissions: ugo+rw Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:52 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.info Sep 05 21:09:52 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:52 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4" returned: 0 in 0.538s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:52 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.info" returned: 0 in 0.338s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:52 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4 Sep 05 21:09:52 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:52 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e7b676e0-35db-406f-93fa-9e0599c30a2e tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:09:52 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9637c85e-dede-444b-a9a6-f47c61f244e4" returned: 0 in 0.322s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-9637c85e-dede-444b-a9a6-f47c61f244e4" released by "delete_volume" :: held 0.916s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created reservations ['4feeebd4-896a-4243-b829-32aecd0250fa', '2794b240-11ca-4426-967f-c0de4d7119c4', '1643b75e-3afa-4565-ba95-e6ee36d985d4', '662dbc7f-a87e-408c-8356-823b4ac78b29'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:52 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:52 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-3105906a-c7b7-4a61-8be7-330af19ac7ef" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3105906a-c7b7-4a61-8be7-330af19ac7ef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 of volume 3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec3f49-ae28-4316-a7c6-ff0ab85334dc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:53 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.385s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Deleted volume successfully. Sep 05 21:09:53 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 Sep 05 21:09:53 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6b4b062d-deaf-4cb7-8405-59f3c2cbd54a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-9637c85e-dede-444b-a9a6-f47c61f244e4-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:53 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" returned: 0 in 0.440s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3105906a-c7b7-4a61-8be7-330af19ac7ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1794dace-ac14-4599-a706-b9815c77a8f7]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:53 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef Sep 05 21:09:53 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-quobyte-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa408164-e416-4ed6-b107-522662459a4c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:54 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef" returned: 0 in 0.500s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:54 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 Sep 05 21:09:54 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:54 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d Sep 05 21:09:54 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:54 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" returned: 0 in 0.386s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:54 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4 Sep 05 21:09:54 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:54 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d" returned: 0 in 0.496s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:54 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d Sep 05 21:09:54 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:54 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d" returned: 0 in 0.396s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:54 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef.9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" returned: 0 in 0.462s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:54 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d" released by "delete_volume" :: held 0.958s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4" released by "_delete_snapshot" :: held 1.969s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3105906a-c7b7-4a61-8be7-330af19ac7ef" released by "delete_snapshot" :: held 2.018s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created reservations ['c57876a0-1095-4f2b-9444-95815ecece4f', '44bbd965-1079-4c5a-af8a-e74178259abc', 'bfa414fc-4109-402d-a51f-8f21a78a08cd', 'aa3c9c93-4505-4a33-8e56-9daf4c1f0fbd'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Created reservations ['a3689d93-f33d-4ad2-b22e-7260f3beb553', '26024b62-6b94-497c-b85e-43579a57db40', 'c82992c3-cd71-42e3-92ff-cfc9796ac157', 'ace8587f-10ff-46e8-843d-a41dcf66d633'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:55 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:55 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:55 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7a63630c-c052-4569-a351-5b73a9ef9f7f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-9bbb47f4-67ea-4bd0-a104-c32b4f64b1a4-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:55 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.440s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:55 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Deleted volume successfully. Sep 05 21:09:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-6a0ff8ff-7c21-46aa-9c27-5dcecb935a97 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-504f50b6-7ccb-4ab9-adfa-e0e5a249c81d-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-48938fa8-3193-4242-844c-82b8e9024ba7-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-48938fa8-3193-4242-844c-82b8e9024ba7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-quobyte-48938fa8-3193-4242-844c-82b8e9024ba7" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-48938fa8-3193-4242-844c-82b8e9024ba7" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[913de274-1d7f-47eb-8bbb-1951f607d2b8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-3105906a-c7b7-4a61-8be7-330af19ac7ef-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-3105906a-c7b7-4a61-8be7-330af19ac7ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-3105906a-c7b7-4a61-8be7-330af19ac7ef" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3105906a-c7b7-4a61-8be7-330af19ac7ef" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:56 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 Sep 05 21:09:56 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc53bbab-8ed6-410d-b508-be2ca73d0d7f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:56 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef Sep 05 21:09:56 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:56 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7" returned: 0 in 0.464s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:56 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7 Sep 05 21:09:56 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:57 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef" returned: 0 in 0.494s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:57 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef Sep 05 21:09:57 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:57 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-48938fa8-3193-4242-844c-82b8e9024ba7" returned: 0 in 0.320s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-48938fa8-3193-4242-844c-82b8e9024ba7" released by "delete_volume" :: held 0.868s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created reservations ['57f29d79-cb93-4421-8838-fe45c515ffbf', '4f18537d-bf64-45a6-ae8f-2adad9212f24', 'f1558d78-c875-4446-93a2-c91dbe72aa2e', '1260b776-70c0-4776-9394-e66755de1984'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:57 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3105906a-c7b7-4a61-8be7-330af19ac7ef" returned: 0 in 0.379s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3105906a-c7b7-4a61-8be7-330af19ac7ef" released by "delete_volume" :: held 0.967s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:57 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:57 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Created reservations ['4a4b7bb5-fdd8-4ddb-b77d-f7474753b814', '5392609f-39aa-436f-b39c-d7c7f2e69af3', '7ab4ce1e-d4c2-4a09-a9fb-4a5fc225e744', '15667352-e897-465f-93f1-6bc57be2a6f0'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:57 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:57 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:57 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Deleted volume successfully. Sep 05 21:09:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-78389652-5f76-4a91-91a2-ba4735f91a7a tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-48938fa8-3193-4242-844c-82b8e9024ba7-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:58 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.336s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:09:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-3422f750-86a4-49c3-b1c8-083cc2584822 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-3105906a-c7b7-4a61-8be7-330af19ac7ef-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-9546fec6-a446-4280-98e0-b6ca33302102-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-9546fec6-a446-4280-98e0-b6ca33302102-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=231,cinder:UPDATE=286,cinder:INSERT=61,cinder:DELETE=25 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "cinder-quobyte-9546fec6-a446-4280-98e0-b6ca33302102" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-9546fec6-a446-4280-98e0-b6ca33302102" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5ff86-cb07-41f5-8764-a55594deca0c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:09:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:58 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 Sep 05 21:09:58 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:59 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102" returned: 0 in 0.458s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:59 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102 Sep 05 21:09:59 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=202,cinder:UPDATE=301,cinder:INSERT=90,cinder:DELETE=27 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (cc6eb8d7-0b27-458b-b56b-d94d713fed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2248379f-5029-4321-810f-42c4df0c6715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2248379f-5029-4321-810f-42c4df0c6715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142914943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:59Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456e77d8-b344-4792-ae40-2820cd6e5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456e77d8-b344-4792-ae40-2820cd6e5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ea4240-4af5-43df-bd79-b053f9bc798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ea4240-4af5-43df-bd79-b053f9bc798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37', 'volume_name': 'volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21149e63-5b2b-4363-a747-153a541069f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21149e63-5b2b-4363-a747-153a541069f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebc4307-cb68-46f9-96ad-14056a038cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:09:59 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Volume e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37', 'volume_size': 1} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142914943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:09:59Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Creating volume e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:09:59 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:59 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 1073741824 Sep 05 21:09:59 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:59 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9546fec6-a446-4280-98e0-b6ca33302102" returned: 0 in 0.331s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-quobyte-9546fec6-a446-4280-98e0-b6ca33302102" released by "delete_volume" :: held 0.859s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Created reservations ['5d2e16a7-926c-493f-a240-affdd984f170', '04f5a459-424c-4b82-bf07-89e2c0139d27', 'dcdf893a-06c1-4ed8-97d3-7cfaa6dc989a', 'b878586d-454d-43c3-9eb2-c40cc77c7c62'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:09:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:09:59 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:09:59 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:09:59 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.302s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:00 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:00 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Deleted volume successfully. Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 1073741824" returned: 0 in 0.628s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-201ac53f-adf2-4cb2-95b1-b6be7c997290 tempest-CreateVolumesFromSourceVolumeTest-1979728506 None] Lock "cinder-9546fec6-a446-4280-98e0-b6ca33302102-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:00 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 Sep 05 21:10:00 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:00 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (0cf5581d-5c4d-4698-b851-1f896d22321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f6ec37-1442-4d25-8d21-8f2e80d368c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" returned: 0 in 0.408s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f6ec37-1442-4d25-8d21-8f2e80d368c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674284554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f39c02-19c9-48fd-b7fb-31f20460fba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:00Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48125901-c2b3-4c4e-9a22-6f114c45451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48125901-c2b3-4c4e-9a22-6f114c45451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76ca0e3-0825-4fce-b325-0b9894d33b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76ca0e3-0825-4fce-b325-0b9894d33b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f39c02-19c9-48fd-b7fb-31f20460fba7', 'volume_name': 'volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae71cd5b-4913-45a2-93d7-1c049391c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae71cd5b-4913-45a2-93d7-1c049391c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabf46f4-5d29-45f6-a6e8-b6169a1e0fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:00 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Volume e8f39c02-19c9-48fd-b7fb-31f20460fba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7', 'volume_size': 1} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674284554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f39c02-19c9-48fd-b7fb-31f20460fba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:00Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Creating volume e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:00 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebc4307-cb68-46f9-96ad-14056a038cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e631f81-d89e-4ff0-adc6-a5fb9a8d5901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:00 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 1073741824 Sep 05 21:10:00 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:00 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Volume volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 (e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37): created successfully Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e631f81-d89e-4ff0-adc6-a5fb9a8d5901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:00 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (cc6eb8d7-0b27-458b-b56b-d94d713fed80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:00 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-aac28238-77c1-4527-9768-eff662be32cd tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:10:01 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 1073741824" returned: 0 in 0.545s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:01 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 Sep 05 21:10:01 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:01 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7" returned: 0 in 0.390s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabf46f4-5d29-45f6-a6e8-b6169a1e0fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56db64d-09fb-4aa2-865a-696bd7896723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:01 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Volume volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 (e8f39c02-19c9-48fd-b7fb-31f20460fba7): created successfully Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56db64d-09fb-4aa2-865a-696bd7896723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (0cf5581d-5c4d-4698-b851-1f896d22321c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9ce0edb4-f20a-427e-93a7-e85b7f77775f tempest-ProjectReaderTests-168536386 None] Created volume successfully. Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 760589f4-afcf-4805-b723-52ecfcde13e6 of volume e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[db93904f-dce0-421a-a30d-7e086e09b8f4]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:01 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 Sep 05 21:10:01 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:02 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" returned: 0 in 0.376s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:02 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 1G Sep 05 21:10:02 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:02 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 1G" returned: 0 in 0.664s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:02 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 Sep 05 21:10:02 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:03 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6" returned: 0 in 0.347s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:03 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 is being set with open permissions: ugo+rw Sep 05 21:10:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:03 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 Sep 05 21:10:03 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:03 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6" returned: 0 in 0.311s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:03 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.info Sep 05 21:10:03 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:03 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.info" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:03 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.info is being set with open permissions: ugo+rw Sep 05 21:10:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:03 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.info Sep 05 21:10:03 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:04 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.info" returned: 0 in 0.333s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.135s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Creating offline snapshot bc9a5533-2247-4af8-a04c-574c852c7b5a of volume e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c609f292-d490-41f9-ac85-b8ad73a0df5c tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e1b335-5b3a-46da-ba7c-603ad8b12d9e]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:04 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 Sep 05 21:10:04 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:04 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7" returned: 0 in 0.456s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:04 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a 1G Sep 05 21:10:04 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:04 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:04 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-760589f4-afcf-4805-b723-52ecfcde13e6-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-760589f4-afcf-4805-b723-52ecfcde13e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-760589f4-afcf-4805-b723-52ecfcde13e6" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-760589f4-afcf-4805-b723-52ecfcde13e6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 760589f4-afcf-4805-b723-52ecfcde13e6 of volume e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[de167225-7e8f-4f04-a3c1-069c0d8b36e4]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:05 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.427s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:05 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a 1G" returned: 0 in 0.666s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:05 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 Sep 05 21:10:05 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:05 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a Sep 05 21:10:05 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:05 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6" returned: 0 in 0.518s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6eadc-c9ab-442d-b571-67b868772a7b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:05 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a" returned: 0 in 0.384s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:05 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a is being set with open permissions: ugo+rw Sep 05 21:10:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:05 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a Sep 05 21:10:05 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:05 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 Sep 05 21:10:05 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:06 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a" returned: 0 in 0.306s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:06 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.info Sep 05 21:10:06 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:06 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" returned: 0 in 0.500s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:06 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 Sep 05 21:10:06 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:06 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.info" returned: 0 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:06 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.info is being set with open permissions: ugo+rw Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:06 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.info Sep 05 21:10:06 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:06 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6" returned: 0 in 0.554s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:06 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.info" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:06 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6 Sep 05 21:10:06 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Flow 'volume_create_manager' (3be14db6-b3d5-4248-8f6b-75b770f2ebfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678d49d4-3b30-429f-abb3-bed2b33ba3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678d49d4-3b30-429f-abb3-bed2b33ba3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a7fcc045cd4a9a89c2a47aa15651bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:07Z,use_quota=True,user_id='6fa21ef01bda40f88134ea2dab4cd2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f35d631-85e5-41dc-bb4f-cc055fb3d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f35d631-85e5-41dc-bb4f-cc055fb3d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5cc490-408a-407b-87f2-1ec45015a098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:06 devstack cinder-volume[87778]: DEBUG cinder.image.glance [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Creating Keystone auth plugin from conf {{(pid=87778) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 05 21:10:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-fba49f74-b427-45d0-86f6-01b46d97242a tempest-ProjectReaderTests-168536386 None] Create snapshot completed successfully Sep 05 21:10:07 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37.760589f4-afcf-4805-b723-52ecfcde13e6" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-760589f4-afcf-4805-b723-52ecfcde13e6" released by "_delete_snapshot" :: held 2.044s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" released by "delete_snapshot" :: held 2.083s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Created reservations ['551c65a7-5a0e-4af6-86bc-214b8a758298', '125656b7-7e3f-48c7-84dc-af9cc2753313', 'bf3a91c4-ec49-4e7e-a628-9be923862553', '04d83ec7-6454-43c9-8b64-ba687428c24e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5cc490-408a-407b-87f2-1ec45015a098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d', 'volume_name': 'volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d', 'volume_size': 1, 'image_id': 'e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd014cf41bb9a04cbad25fd02d82efff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73a7fcc045cd4a9a89c2a47aa15651bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a26cac0e9f9df5de30a27105e925bce8ea172ea2c79f9a3802045c2cf637d5aeba0cbaaec82980aa12419cbc1b929462029cbd05f6c11c2051685e8a6597905', 'id': 'e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'created_at': datetime.datetime(2026, 9, 5, 19, 10, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e/file', 'properties': {}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0020edeb-1911-46ee-adcf-ae969be54cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0020edeb-1911-46ee-adcf-ae969be54cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0f19b8-5178-4fb3-b408-3faf30543364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:07 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Volume 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d', 'volume_size': 1, 'image_id': 'e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd014cf41bb9a04cbad25fd02d82efff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73a7fcc045cd4a9a89c2a47aa15651bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a26cac0e9f9df5de30a27105e925bce8ea172ea2c79f9a3802045c2cf637d5aeba0cbaaec82980aa12419cbc1b929462029cbd05f6c11c2051685e8a6597905', 'id': 'e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'created_at': datetime.datetime(2026, 9, 5, 19, 10, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e/file', 'properties': {}}, 'image_service': } Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Trying to clone 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d from image e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e at location (None, [{'url': 'file:///opt/stack/data/glance/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'metadata': {}}]). {{(pid=87778) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 05 21:10:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bcfa3ab7-ceed-408b-94f7-3c9d994a79a4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-760589f4-afcf-4805-b723-52ecfcde13e6-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 05 21:10:07 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Image download 0.00 MB at 0.00 MB/s Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a7c00c-ec0d-42c2-8b19-98ea92ae7c76]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-bc9a5533-2247-4af8-a04c-574c852c7b5a-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Lock "cinder-bc9a5533-2247-4af8-a04c-574c852c7b5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-e8f39c02-19c9-48fd-b7fb-31f20460fba7" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-e8f39c02-19c9-48fd-b7fb-31f20460fba7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-bc9a5533-2247-4af8-a04c-574c852c7b5a" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:07 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD Sep 05 21:10:07 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-bc9a5533-2247-4af8-a04c-574c852c7b5a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Deleting offline snapshot bc9a5533-2247-4af8-a04c-574c852c7b5a of volume e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] snapshot_file for this snap is: volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd44bd8e-aa41-4119-840b-fb43dc3e9c81]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:07 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a Sep 05 21:10:07 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:08 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:08 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD Sep 05 21:10:08 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:08 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a" returned: 0 in 0.463s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea269c01-fe46-440b-b7c0-767447e6771f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Lock "cinder-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:08 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD" returned: 1 in 0.455s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Temporary image e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e is fetched for user 6fa21ef01bda40f88134ea2dab4cd2df. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:08 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 Sep 05 21:10:08 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9575e031-ba81-4cd8-b7fb-c6d1cccf2ca5]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe92683-b89e-4614-a800-1aac180bf440]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:08 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD Sep 05 21:10:08 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:08 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 Sep 05 21:10:08 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:08 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7" returned: 0 in 0.548s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:08 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a Sep 05 21:10:08 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:09 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:09 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" returned: 0 in 0.605s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:09 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37 Sep 05 21:10:09 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:09 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD Sep 05 21:10:09 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Flow 'volume_create_manager' (14d475a6-6e9e-4e6a-add0-4af4393521d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03c29eb-421f-49cf-bd0d-3e2f746ecd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03c29eb-421f-49cf-bd0d-3e2f746ecd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1035120526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371edc1-2cca-4a88-a2f7-cec212c2e708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e5f60b1a74fddb54f903eac84838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:09Z,use_quota=True,user_id='6d434a2db72648be8841cd1b79184a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a13ee5-9b88-44ac-8ecc-8e85f77b9b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a13ee5-9b88-44ac-8ecc-8e85f77b9b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63922ef-d87b-40ed-b083-886012b382a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63922ef-d87b-40ed-b083-886012b382a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8371edc1-2cca-4a88-a2f7-cec212c2e708', 'volume_name': 'volume-8371edc1-2cca-4a88-a2f7-cec212c2e708', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e308c56-740c-4811-bd03-af96b9d9898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e308c56-740c-4811-bd03-af96b9d9898d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b775ef-4dfd-4fd5-b0df-de90a4434a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:09 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Volume 8371edc1-2cca-4a88-a2f7-cec212c2e708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8371edc1-2cca-4a88-a2f7-cec212c2e708', 'volume_size': 1} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1035120526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8371edc1-2cca-4a88-a2f7-cec212c2e708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e5f60b1a74fddb54f903eac84838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:09Z,use_quota=True,user_id='6d434a2db72648be8841cd1b79184a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Creating volume 8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:09 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:09 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:09 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 1073741824 Sep 05 21:10:09 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:09 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a Sep 05 21:10:09 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:09 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:10:09 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" returned: 0 in 0.321s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37" released by "delete_volume" :: held 1.015s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Created reservations ['36a7c09a-b2ea-46f5-92a3-26ae19e75520', '326c0a69-ca28-499c-86d4-59f208cb908e', 'cc853d2b-8275-4d57-b15d-f4cda6badc61', 'efde5a71-7a1b-4e2b-a0cc-d51cbad4a495'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:09 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7.bc9a5533-2247-4af8-a04c-574c852c7b5a" returned: 0 in 0.296s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:09 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-bc9a5533-2247-4af8-a04c-574c852c7b5a" released by "_delete_snapshot" :: held 1.945s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-e8f39c02-19c9-48fd-b7fb-31f20460fba7" released by "delete_snapshot" :: held 1.985s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Created reservations ['de84f02f-a710-43a0-9101-a0d8e165cfc1', '4ee58c55-c268-4486-84b4-acb536b403ff', '3a6cab54-8ef3-473a-b490-2b82d4b6797e', 'e44e20f7-5fe6-49d7-9eab-5303383d3474'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:09 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 1073741824" returned: 0 in 0.452s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Delete snapshot completed successfully. Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c3918b16-9d33-414c-ac67-2d5f9da68d50 tempest-ProjectReaderTests-168536386 None] Lock "cinder-bc9a5533-2247-4af8-a04c-574c852c7b5a-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:09 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 Sep 05 21:10:09 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:09 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.273s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:09 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:10:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-82906313-d67e-4609-b944-e80377b6d51e tempest-ProjectMemberTests-1286767482 None] Lock "cinder-e86e40e9-e4a0-4ec2-9dcc-d19c8dfeab37-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:10 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708" returned: 0 in 0.260s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a7fcc045cd4a9a89c2a47aa15651bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:07Z,use_quota=True,user_id='6fa21ef01bda40f88134ea2dab4cd2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Creating volume 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:10 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b775ef-4dfd-4fd5-b0df-de90a4434a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8371edc1-2cca-4a88-a2f7-cec212c2e708', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203668ba-5b8d-4de7-a91b-76e017e62ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:10 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d 1073741824 Sep 05 21:10:10 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:10 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Volume volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 (8371edc1-2cca-4a88-a2f7-cec212c2e708): created successfully Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203668ba-5b8d-4de7-a91b-76e017e62ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Flow 'volume_create_manager' (14d475a6-6e9e-4e6a-add0-4af4393521d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:10 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-9b6e6d37-a107-42a9-b979-e44ef8c452ed tempest-SnapshotDependencyTests-463186045 None] Created volume successfully. Sep 05 21:10:10 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d 1073741824" returned: 0 in 0.408s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:10 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d Sep 05 21:10:10 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:10 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d" returned: 0 in 0.257s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Attempting download of e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e ((None, [{'url': 'file:///opt/stack/data/glance/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'metadata': {}}])) to volume 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eecde8a-337f-4c5e-96dc-608c70747136]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_1s1z5iy4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-e8f39c02-19c9-48fd-b7fb-31f20460fba7-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Lock "cinder-e8f39c02-19c9-48fd-b7fb-31f20460fba7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-e8f39c02-19c9-48fd-b7fb-31f20460fba7" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-e8f39c02-19c9-48fd-b7fb-31f20460fba7" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:11 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_1s1z5iy4 Sep 05 21:10:11 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd389a-6e38-4400-bcca-55dd7e88a74c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (42146cc2-7272-4807-80ea-577eff42cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0a6437-6f79-4c12-890e-9c68625bdac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b0a6437-6f79-4c12-890e-9c68625bdac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793603486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4da4a3-bd56-455b-af0f-0f04c0d28854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:11Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc478570-b913-41d0-a69b-3954e31a6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc478570-b913-41d0-a69b-3954e31a6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920e6a0b-c570-4b48-b7c8-7f6dbf92e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920e6a0b-c570-4b48-b7c8-7f6dbf92e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4da4a3-bd56-455b-af0f-0f04c0d28854', 'volume_name': 'volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbfd769-cec2-4911-992a-494fa8e7bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbfd769-cec2-4911-992a-494fa8e7bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:11 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 Sep 05 21:10:11 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd294a20-12b0-4062-899c-8d7dc306afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:11 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Volume 1e4da4a3-bd56-455b-af0f-0f04c0d28854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854', 'volume_size': 1} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793603486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4da4a3-bd56-455b-af0f-0f04c0d28854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:11Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Creating volume 1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:11 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:11 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 1073741824 Sep 05 21:10:11 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:11 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_1s1z5iy4" returned: 0 in 0.411s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_1s1z5iy4 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:11 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_1s1z5iy4 Sep 05 21:10:11 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:11 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7" returned: 0 in 0.461s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:11 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7 Sep 05 21:10:11 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:11 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_1s1z5iy4" returned: 1 in 0.407s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_1s1z5iy4' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8028eb0e-2e79-438b-9b55-d6933db45c3f]: (4, 'raw') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:11 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 1073741824" returned: 0 in 0.524s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:11 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 Sep 05 21:10:11 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:11 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e8f39c02-19c9-48fd-b7fb-31f20460fba7" returned: 0 in 0.299s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:11 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD Sep 05 21:10:11 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-e8f39c02-19c9-48fd-b7fb-31f20460fba7" released by "delete_volume" :: held 0.838s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Created reservations ['f784e29d-7697-450e-b661-09af19d9e679', '4e5a3a41-b587-4676-b990-c1df5cbb1fe5', '03567336-cc9d-46e1-8ea5-60ca44a8ac2e', '852dd44f-0670-48e4-9a9b-82235e3527af'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:12 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:12 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:12 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854" returned: 0 in 0.325s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:12 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.547s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd294a20-12b0-4062-899c-8d7dc306afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f040b8-3ab6-4e8f-8a97-7194b796e4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Creating offline snapshot df0c60fc-c569-44a6-a96c-5dab4cd644ba of volume 8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:12 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Volume volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 (1e4da4a3-bd56-455b-af0f-0f04c0d28854): created successfully Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f040b8-3ab6-4e8f-8a97-7194b796e4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (42146cc2-7272-4807-80ea-577eff42cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e40b17e-b470-497d-8928-b93d0c75e101]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:12 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4e527f35-a425-4462-9de3-7731fb79f1bb tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:10:12 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD Sep 05 21:10:12 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:12 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.356s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:12 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Deleted volume successfully. Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ff5348c8-2990-461d-ad51-e5754bb5348f tempest-ProjectReaderTests-168536386 None] Lock "cinder-e8f39c02-19c9-48fd-b7fb-31f20460fba7-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:12 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 Sep 05 21:10:12 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:12 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e was raw, converting to qcow2 {{(pid=87778) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:12 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d Sep 05 21:10:12 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (8708358b-d070-4f65-ae1a-2530e88d329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2793927-24d0-4a41-ad3c-ecb0c8606056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:12 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2793927-24d0-4a41-ad3c-ecb0c8606056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640592257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaebc89-9819-4b62-9e3f-a08abe5f1471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:13Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82f5081-9946-475a-9ff5-dd16a30d1e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82f5081-9946-475a-9ff5-dd16a30d1e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76f2f44-70dc-4cc1-b556-f1dba0eaff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76f2f44-70dc-4cc1-b556-f1dba0eaff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aaebc89-9819-4b62-9e3f-a08abe5f1471', 'volume_name': 'volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1447769f-b94a-41ca-af06-e20947485a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1447769f-b94a-41ca-af06-e20947485a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a874ca-bf59-4760-893b-62515e40e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:12 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Volume 8aaebc89-9819-4b62-9e3f-a08abe5f1471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471', 'volume_size': 1} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708" returned: 0 in 0.525s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:12 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba 1G Sep 05 21:10:12 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:12 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d" returned: 0 in 0.424s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e_rskbylc6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:10:12 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Converted 0.00 MB image at 0.00 MB/s Sep 05 21:10:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:13 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d 1G Sep 05 21:10:13 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:13 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba 1G" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:13 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba Sep 05 21:10:13 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:13 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d 1G" returned: 0 in 0.376s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Downloaded image e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e ((None, [{'url': 'file:///opt/stack/data/glance/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'metadata': {}}])) to volume 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d successfully. {{(pid=87778) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Temporary image e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e for user 6fa21ef01bda40f88134ea2dab4cd2df is deleted. {{(pid=87778) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.volume_utils [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Marking volume 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d as bootable. {{(pid=87778) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Copying metadata from image e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e to 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d. {{(pid=87778) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Creating volume glance metadata for volume 6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d backed by image e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e with: {'image_id': 'e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dd014cf41bb9a04cbad25fd02d82efff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87778) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0f19b8-5178-4fb3-b408-3faf30543364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d', 'volume_size': 1, 'image_id': 'e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd014cf41bb9a04cbad25fd02d82efff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73a7fcc045cd4a9a89c2a47aa15651bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6a26cac0e9f9df5de30a27105e925bce8ea172ea2c79f9a3802045c2cf637d5aeba0cbaaec82980aa12419cbc1b929462029cbd05f6c11c2051685e8a6597905', 'id': 'e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e', 'created_at': datetime.datetime(2026, 9, 5, 19, 10, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 5, 19, 10, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e59fdb24-ebeb-4ddb-8ce0-6196d695cb0e/file', 'properties': {}}, 'image_service': }' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ad9fe0-0a28-4508-be72-4394703339e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:13 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Volume volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d (6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d): created successfully Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ad9fe0-0a28-4508-be72-4394703339e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Flow 'volume_create_manager' (3be14db6-b3d5-4248-8f6b-75b770f2ebfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4e995b67-4ad1-4019-89a0-13c61cd0adaa tempest-VolumeImageDependencyTests-1900382468 None] Created volume successfully. Sep 05 21:10:13 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba" returned: 0 in 0.341s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:13 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba is being set with open permissions: ugo+rw Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:13 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba Sep 05 21:10:13 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:13 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba" returned: 0 in 0.243s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:13 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.info Sep 05 21:10:13 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:14 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.info" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:14 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.info is being set with open permissions: ugo+rw Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:14 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.info Sep 05 21:10:14 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:14 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.info" returned: 0 in 0.250s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640592257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaebc89-9819-4b62-9e3f-a08abe5f1471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:13Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Creating volume 8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:14 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:14 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 1073741824 Sep 05 21:10:14 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Acquiring lock "cinder-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:14 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-29054eec-68bb-45a5-aea0-bc88a9fc6b99 tempest-SnapshotDependencyTests-463186045 None] Create snapshot completed successfully Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Lock "cinder-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Acquiring lock "cinder-quobyte-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Lock "cinder-quobyte-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a246d63-8e15-4dd6-9ae8-b6c438af0004]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:14 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d Sep 05 21:10:14 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:14 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 1073741824" returned: 0 in 0.511s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:14 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 Sep 05 21:10:14 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:14 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d" returned: 0 in 0.424s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:14 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d Sep 05 21:10:14 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:15 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.861s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 2e76b140-2a7a-45fd-8a5c-5c35dd53c242 of volume 1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:15 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a874ca-bf59-4760-893b-62515e40e435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b062b707-c4d3-4a61-940e-d5106100717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d332d632-4515-48c6-801b-24e662743d3f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:15 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Volume volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 (8aaebc89-9819-4b62-9e3f-a08abe5f1471): created successfully Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b062b707-c4d3-4a61-940e-d5106100717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (8708358b-d070-4f65-ae1a-2530e88d329e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Lock "cinder-quobyte-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d" released by "delete_volume" :: held 0.819s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-61e29ab1-9b4a-4773-a9da-a8ba48c60b4f tempest-ProjectReaderTests-168536386 None] Created volume successfully. Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Flow 'volume_create_manager' (8cd7a5b1-cf3a-4346-8810-15b7b5e929d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:15 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 Sep 05 21:10:15 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f500e2a-273d-4fe5-9134-91d875dd9b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f500e2a-273d-4fe5-9134-91d875dd9b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a01da6c-8e92-4c35-80cb-c2ddb514c08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='274e5f60b1a74fddb54f903eac84838b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=df0c60fc-c569-44a6-a96c-5dab4cd644ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:15Z,use_quota=True,user_id='6d434a2db72648be8841cd1b79184a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d7abc1-e7e2-47ea-9256-5cc6a3068759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d7abc1-e7e2-47ea-9256-5cc6a3068759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d29402-a898-4936-b67b-bd9a4fcf37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95d29402-a898-4936-b67b-bd9a4fcf37d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a01da6c-8e92-4c35-80cb-c2ddb514c08a', 'volume_name': 'volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a', 'volume_size': 1, 'snapshot_id': 'df0c60fc-c569-44a6-a96c-5dab4cd644ba'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff2ee15-04c0-452b-b02e-6589bc826792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff2ee15-04c0-452b-b02e-6589bc826792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326dca7b-165f-4947-acf2-8156968736f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:15 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Volume 4a01da6c-8e92-4c35-80cb-c2ddb514c08a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a', 'volume_size': 1, 'snapshot_id': 'df0c60fc-c569-44a6-a96c-5dab4cd644ba'} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Created reservations ['4f13387a-47a5-4252-bb88-616780dff536', 'c55fce1e-760e-43df-9053-c1ee32360351', 'd41518b2-739a-472f-8c9f-16423262337e', '6de75381-dc40-4938-b5ae-f3b46383cdc8'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:15 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:15 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:15 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854" returned: 0 in 0.397s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:15 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 1G Sep 05 21:10:15 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:15 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.301s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Deleted volume successfully. Sep 05 21:10:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c8938767-ee46-4703-af6a-2fe7522f52d7 tempest-VolumeImageDependencyTests-1900382468 None] Lock "cinder-6eab3629-c1ca-4e47-b1fc-a4ad56cdfd1d-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:16 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 1G" returned: 0 in 0.497s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:16 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 Sep 05 21:10:16 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:16 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242" returned: 0 in 0.330s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:16 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 is being set with open permissions: ugo+rw Sep 05 21:10:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:16 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 Sep 05 21:10:16 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:16 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242" returned: 0 in 0.309s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:16 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.info Sep 05 21:10:16 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:17 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.info" returned: 0 in 0.321s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:17 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.info is being set with open permissions: ugo+rw Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:17 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.info Sep 05 21:10:17 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:17 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.info" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.993s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-quobyte-df0c60fc-c569-44a6-a96c-5dab4cd644ba-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" by "_create_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-df0c60fc-c569-44a6-a96c-5dab4cd644ba-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Creating volume 4a01da6c-8e92-4c35-80cb-c2ddb514c08a from snapshot df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-quobyte-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" by "_copy_volume_from_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8b5644bb-f6e1-4219-b8e9-529d58ac399c tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] snapshot: df0c60fc-c569-44a6-a96c-5dab4cd644ba, volume: 4a01da6c-8e92-4c35-80cb-c2ddb514c08a, {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[9806eecc-5c0a-489a-af54-8626ce487033]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:17 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba Sep 05 21:10:17 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:17 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba" returned: 0 in 0.374s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8371edc1-2cca-4a88-a2f7-cec212c2e708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9831023-7f48-4f81-9146-9b9b337b8adc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:18 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 Sep 05 21:10:18 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:18 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708" returned: 0 in 0.384s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Creating direct copy from snapshot {{(pid=87778) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.utils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Path /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a not found in is_blk_device check {{(pid=87778) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:18 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a Sep 05 21:10:18 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-2e76b140-2a7a-45fd-8a5c-5c35dd53c242-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-2e76b140-2a7a-45fd-8a5c-5c35dd53c242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-1e4da4a3-bd56-455b-af0f-0f04c0d28854" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1e4da4a3-bd56-455b-af0f-0f04c0d28854" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-2e76b140-2a7a-45fd-8a5c-5c35dd53c242" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-2e76b140-2a7a-45fd-8a5c-5c35dd53c242" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 2e76b140-2a7a-45fd-8a5c-5c35dd53c242 of volume 1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46790f8-9ff9-4c2e-9278-316a3c2a2cf9]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:18 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 Sep 05 21:10:18 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:19 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242" returned: 0 in 0.645s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:19 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c57d8-1480-42f4-87bf-09eb6eadac51]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:19 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 Sep 05 21:10:19 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:20 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854" returned: 0 in 0.979s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:20 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:20 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 Sep 05 21:10:20 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:21 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242" returned: 0 in 0.843s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:21 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242 Sep 05 21:10:21 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:21 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:21 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854.2e76b140-2a7a-45fd-8a5c-5c35dd53c242" returned: 0 in 0.478s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-2e76b140-2a7a-45fd-8a5c-5c35dd53c242" released by "_delete_snapshot" :: held 3.134s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:21 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1e4da4a3-bd56-455b-af0f-0f04c0d28854" released by "delete_snapshot" :: held 3.173s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:22 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Created reservations ['b77b99f3-9b41-4638-9a2a-50f1d014d3bf', '9f1ababa-38ed-4fcd-8997-31cbe6b9300c', '51dfd5d7-3bc7-4b00-bea5-01b85deaea9a', '09f7a4cb-e5da-48e7-b4b9-58523f0b2c58'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:22 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:10:22 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-bc40892e-293a-4117-a7f0-60a07a095cf6 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-2e76b140-2a7a-45fd-8a5c-5c35dd53c242-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-1e4da4a3-bd56-455b-af0f-0f04c0d28854-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-1e4da4a3-bd56-455b-af0f-0f04c0d28854-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-1e4da4a3-bd56-455b-af0f-0f04c0d28854" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1e4da4a3-bd56-455b-af0f-0f04c0d28854" acquired by "delete_volume" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dda4dd6-1dce-4d6b-91a6-95f21077752f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:23 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 Sep 05 21:10:23 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:23 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" returned: 0 in 5.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG cinder.image.image_utils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Image conversion details: src /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a {{(pid=87778) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 05 21:10:23 devstack cinder-volume[87778]: INFO cinder.image.image_utils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Converted 1024.00 MB image at 192.81 MB/s Sep 05 21:10:23 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a is being set with open permissions: ugo+rw Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:23 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a Sep 05 21:10:23 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:23 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854" returned: 0 in 0.505s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:23 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854 Sep 05 21:10:23 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:23 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" returned: 0 in 0.277s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:23 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" released by "_copy_volume_from_snapshot" :: held 6.433s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-df0c60fc-c569-44a6-a96c-5dab4cd644ba-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" released by "_create_volume_from_snapshot" :: held 6.506s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.532s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.992s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Creating offline snapshot b517fc88-45f6-4eff-a434-fc3ec24e3ab9 of volume 8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (326dca7b-165f-4947-acf2-8156968736f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a', 'volume_size': 1, 'snapshot_id': 'df0c60fc-c569-44a6-a96c-5dab4cd644ba'}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3db0916-167a-48f4-892c-43775409df9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f07b72-1fe9-4171-88b4-6d412a15dd58]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:24 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Volume volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a (4a01da6c-8e92-4c35-80cb-c2ddb514c08a): created successfully Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3db0916-167a-48f4-892c-43775409df9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Flow 'volume_create_manager' (8cd7a5b1-cf3a-4346-8810-15b7b5e929d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-eee5aacc-f533-45e0-be74-46b4ac816fdc tempest-SnapshotDependencyTests-463186045 None] Created volume successfully. Sep 05 21:10:24 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-1e4da4a3-bd56-455b-af0f-0f04c0d28854" returned: 0 in 0.311s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-1e4da4a3-bd56-455b-af0f-0f04c0d28854" released by "delete_volume" :: held 0.922s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:24 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 Sep 05 21:10:24 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Created reservations ['160f03c4-b9fc-4f9d-a9eb-042e33b583d5', '8d298780-96cf-41c4-9acb-4016c153a595', '05788f91-a573-43a0-9c94-c01bd438b96a', 'bc4faabe-e8e3-4663-9c15-538e195def3e'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:24 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:24 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-df0c60fc-c569-44a6-a96c-5dab4cd644ba-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-df0c60fc-c569-44a6-a96c-5dab4cd644ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-quobyte-8371edc1-2cca-4a88-a2f7-cec212c2e708" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:24 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-8371edc1-2cca-4a88-a2f7-cec212c2e708" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-quobyte-df0c60fc-c569-44a6-a96c-5dab4cd644ba" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471" returned: 0 in 0.467s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:24 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:24 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 1G Sep 05 21:10:24 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-df0c60fc-c569-44a6-a96c-5dab4cd644ba" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Deleting offline snapshot df0c60fc-c569-44a6-a96c-5dab4cd644ba of volume 8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] snapshot_file for this snap is: volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.304s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:24 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[351cd300-3005-4a7f-8146-f3dc6ba57dfc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:24 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b7d99f7f-2655-40e6-b1f3-3342b396e099 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-1e4da4a3-bd56-455b-af0f-0f04c0d28854-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:24 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba Sep 05 21:10:24 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:25 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 1G" returned: 0 in 0.480s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:25 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 Sep 05 21:10:25 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:25 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (9dbf2520-fca1-4311-b8e3-6ecb2d1c2c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c7ddb0-335d-4fdf-996e-5fc107301306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba" returned: 0 in 0.476s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8371edc1-2cca-4a88-a2f7-cec212c2e708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c7ddb0-335d-4fdf-996e-5fc107301306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155899116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddbaa13-a862-4474-8352-aa4768804cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:25Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2accfc-216f-4f26-922e-877804917e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2accfc-216f-4f26-922e-877804917e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a759c11-a18c-4698-979b-d5151e7ca66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a759c11-a18c-4698-979b-d5151e7ca66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddbaa13-a862-4474-8352-aa4768804cad', 'volume_name': 'volume-3ddbaa13-a862-4474-8352-aa4768804cad', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d27dba0-1310-495e-901c-134b461af1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d27dba0-1310-495e-901c-134b461af1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8bfba9-a3ef-4b7a-9323-d6875064cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:25 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Volume 3ddbaa13-a862-4474-8352-aa4768804cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddbaa13-a862-4474-8352-aa4768804cad', 'volume_size': 1} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8b862a-bfa7-4e4c-87f4-cf3e8895d590]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:25 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 Sep 05 21:10:25 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:25 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9" returned: 0 in 0.347s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:25 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 is being set with open permissions: ugo+rw Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:25 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 Sep 05 21:10:25 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:25 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9" returned: 0 in 0.282s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:25 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.info Sep 05 21:10:25 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:25 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708" returned: 0 in 0.596s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:25 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba Sep 05 21:10:25 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:25 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.info" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:25 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.info is being set with open permissions: ugo+rw Sep 05 21:10:25 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:26 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.info Sep 05 21:10:26 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:26 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba" returned: 0 in 0.343s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:26 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba Sep 05 21:10:26 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:26 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.info" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.078s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155899116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddbaa13-a862-4474-8352-aa4768804cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:25Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Creating volume 3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:26 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:26 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad 1073741824 Sep 05 21:10:26 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8270f5dd-32d4-4d8b-8fe8-e58a3794d586 tempest-ProjectReaderTests-168536386 None] Create snapshot completed successfully Sep 05 21:10:26 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708.df0c60fc-c569-44a6-a96c-5dab4cd644ba" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-df0c60fc-c569-44a6-a96c-5dab4cd644ba" released by "_delete_snapshot" :: held 1.842s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-8371edc1-2cca-4a88-a2f7-cec212c2e708" released by "delete_snapshot" :: held 1.901s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Created reservations ['6f60bd78-7cca-4701-9217-9738aec6fdf8', '41fbae0c-924e-44fb-86f2-93f1fe2bbc18', '1043d907-515b-4960-94b2-47b5fa735d51', 'd2ac6c6e-8010-4557-af9c-b848f5181efe'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:26 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Delete snapshot completed successfully. Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2ebe35c3-946c-45de-a94d-97f4ce1b5070 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-df0c60fc-c569-44a6-a96c-5dab4cd644ba-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-b517fc88-45f6-4eff-a434-fc3ec24e3ab9-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-8371edc1-2cca-4a88-a2f7-cec212c2e708-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Lock "cinder-b517fc88-45f6-4eff-a434-fc3ec24e3ab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-8aaebc89-9819-4b62-9e3f-a08abe5f1471" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-8371edc1-2cca-4a88-a2f7-cec212c2e708-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-8aaebc89-9819-4b62-9e3f-a08abe5f1471" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-b517fc88-45f6-4eff-a434-fc3ec24e3ab9" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-b517fc88-45f6-4eff-a434-fc3ec24e3ab9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Deleting offline snapshot b517fc88-45f6-4eff-a434-fc3ec24e3ab9 of volume 8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:26 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] snapshot_file for this snap is: volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad 1073741824" returned: 0 in 0.542s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac241632-fbc6-4c20-ba07-8273bda396cc]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-quobyte-8371edc1-2cca-4a88-a2f7-cec212c2e708" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-8371edc1-2cca-4a88-a2f7-cec212c2e708" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f31e1-0e80-41f6-8efd-c789ad62eb6f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:26 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:26 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad Sep 05 21:10:26 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:26 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 Sep 05 21:10:26 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:27 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 Sep 05 21:10:27 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:27 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad" returned: 0 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:27 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9" returned: 0 in 0.450s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd8bfba9-a3ef-4b7a-9323-d6875064cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddbaa13-a862-4474-8352-aa4768804cad', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5273da8-a612-4fa2-aa05-9969071dd010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00a5767-0e45-46e9-af42-50e7093fd6d0]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:27 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Volume volume-3ddbaa13-a862-4474-8352-aa4768804cad (3ddbaa13-a862-4474-8352-aa4768804cad): created successfully Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5273da8-a612-4fa2-aa05-9969071dd010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (9dbf2520-fca1-4311-b8e3-6ecb2d1c2c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:27 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-4f0407b2-8b78-457d-aac6-712b305035ce tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:10:27 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708" returned: 0 in 0.513s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:27 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 Sep 05 21:10:27 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:27 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708 Sep 05 21:10:27 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:27 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:27 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471" returned: 0 in 0.398s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8371edc1-2cca-4a88-a2f7-cec212c2e708" returned: 0 in 0.305s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:27 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 Sep 05 21:10:27 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-8371edc1-2cca-4a88-a2f7-cec212c2e708" released by "delete_volume" :: held 0.915s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Created reservations ['14ca6273-6263-4078-8225-9a4d6fe5e1f2', 'a62d3859-3e3c-4b4f-a8de-20bc9dfefa7b', '2fa6846c-c119-44f3-85a0-d8a738a542a5', '0814d459-7a83-49a4-866e-cd0dabe67568'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:27 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:27 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:27 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:28 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9" returned: 0 in 0.416s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:28 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9 Sep 05 21:10:28 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:28 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.294s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Deleted volume successfully. Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7dcdb6d6-faec-427c-bd9b-1f4d092b1dbb tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-8371edc1-2cca-4a88-a2f7-cec212c2e708-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 4d183f08-93a5-4ea6-ae0b-7d9da5675b4a of volume 3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeac04a-c0cd-4e35-b619-550907bbd673]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:28 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471.b517fc88-45f6-4eff-a434-fc3ec24e3ab9" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-b517fc88-45f6-4eff-a434-fc3ec24e3ab9" released by "_delete_snapshot" :: held 1.698s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-8aaebc89-9819-4b62-9e3f-a08abe5f1471" released by "delete_snapshot" :: held 1.732s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Created reservations ['d4fb1f66-f8a7-4054-86ce-f02929b06a76', 'b5ba5496-f284-47c2-9fc7-99c9359d775a', '22fc8895-9efd-4ba8-a7f2-09b329e95b76', '740ec6b6-2801-403c-816b-120e523d8a27'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:28 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad Sep 05 21:10:28 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:28 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Delete snapshot completed successfully. Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8d0a4e78-9bca-46e6-b959-7b077ef3c6d9 tempest-ProjectReaderTests-168536386 None] Lock "cinder-b517fc88-45f6-4eff-a434-fc3ec24e3ab9-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:28 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-8aaebc89-9819-4b62-9e3f-a08abe5f1471-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:28 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a 1G Sep 05 21:10:28 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:28 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Lock "cinder-8aaebc89-9819-4b62-9e3f-a08abe5f1471-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-8aaebc89-9819-4b62-9e3f-a08abe5f1471" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-8aaebc89-9819-4b62-9e3f-a08abe5f1471" acquired by "delete_volume" :: waited 0.032s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-4a01da6c-8e92-4c35-80cb-c2ddb514c08a-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[095a47f8-54c7-4d5c-a19b-26d9ce6b663b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-4a01da6c-8e92-4c35-80cb-c2ddb514c08a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "cinder-quobyte-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[6626846c-7a18-4092-9858-1f7836c6f5d2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:29 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 Sep 05 21:10:29 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:29 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a Sep 05 21:10:29 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:29 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a 1G" returned: 0 in 0.610s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ddbaa13-a862-4474-8352-aa4768804cad -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:29 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ddbaa13-a862-4474-8352-aa4768804cad -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a Sep 05 21:10:29 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:29 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471" returned: 0 in 0.485s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:29 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471 Sep 05 21:10:29 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:29 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" returned: 0 in 0.477s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:29 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a Sep 05 21:10:29 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:29 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ddbaa13-a862-4474-8352-aa4768804cad -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" returned: 0 in 0.356s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:29 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a is being set with open permissions: ugo+rw Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:29 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a Sep 05 21:10:29 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:29 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-8aaebc89-9819-4b62-9e3f-a08abe5f1471" returned: 0 in 0.326s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:29 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-8aaebc89-9819-4b62-9e3f-a08abe5f1471" released by "delete_volume" :: held 0.914s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Created reservations ['1a6ce926-f51b-4869-8460-5ecc2155061d', 'dc33adfd-3206-4b72-a88d-79d6a22c8274', '50c01a08-15bf-4bd8-8350-eca21d751264', '5b061183-a5cd-4a3b-9b7d-ef099d27fcbf'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:30 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" returned: 0 in 0.321s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-quobyte-4a01da6c-8e92-4c35-80cb-c2ddb514c08a" released by "delete_volume" :: held 0.859s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:30 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" returned: 0 in 0.324s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:30 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:30 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Created reservations ['0a90135d-136c-4375-90b6-fc6fcd0e4b3b', '42ba9d00-a35a-4715-9513-da150f1e1110', '186af21b-2499-42b2-8bc1-e212fe7600d9', '5980e276-c620-4847-9ffe-481f57244eea'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:30 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.info Sep 05 21:10:30 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:30 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:30 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:30 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.307s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Deleted volume successfully. Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ef8bfa90-8816-48a9-ab95-30b4ac6b3476 tempest-ProjectReaderTests-168536386 None] Lock "cinder-8aaebc89-9819-4b62-9e3f-a08abe5f1471-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:30 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.info" returned: 0 in 0.317s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:30 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.info is being set with open permissions: ugo+rw Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:30 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.info Sep 05 21:10:30 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:30 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.331s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Deleted volume successfully. Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c859937a-8cf9-437f-8079-6f5ec5e2e6d5 tempest-SnapshotDependencyTests-463186045 None] Lock "cinder-4a01da6c-8e92-4c35-80cb-c2ddb514c08a-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:30 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.info" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:30 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:30 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c07913f8-a959-4d18-8dfe-6bae7920d379 tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-4d183f08-93a5-4ea6-ae0b-7d9da5675b4a-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Lock "cinder-4d183f08-93a5-4ea6-ae0b-7d9da5675b4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-3ddbaa13-a862-4474-8352-aa4768804cad" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3ddbaa13-a862-4474-8352-aa4768804cad" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 4d183f08-93a5-4ea6-ae0b-7d9da5675b4a of volume 3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[895841fe-2919-4efe-be8c-b826d5283cf8]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:31 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a Sep 05 21:10:31 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (b67e15e4-35d1-4359-9bf4-e0af88b25759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2cf81a-f49c-4995-b9d4-49c6bae24c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2cf81a-f49c-4995-b9d4-49c6bae24c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383094247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3505c49e-beb9-4622-a179-ae61bf0b1299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:32Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ef20b2-2897-42b1-9330-ba421b7a860f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ef20b2-2897-42b1-9330-ba421b7a860f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a34366-07d2-4fcd-97ec-99bbb2fb39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a34366-07d2-4fcd-97ec-99bbb2fb39f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3505c49e-beb9-4622-a179-ae61bf0b1299', 'volume_name': 'volume-3505c49e-beb9-4622-a179-ae61bf0b1299', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c78aaa-a2e7-409e-a6a7-ab4051184355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:31 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c78aaa-a2e7-409e-a6a7-ab4051184355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50a2535-6748-4c44-b4be-55de9bb06046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Volume 3505c49e-beb9-4622-a179-ae61bf0b1299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3505c49e-beb9-4622-a179-ae61bf0b1299', 'volume_size': 1} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-383094247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3505c49e-beb9-4622-a179-ae61bf0b1299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:32Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Creating volume 3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:32 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:32 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 1073741824 Sep 05 21:10:32 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:32 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ddbaa13-a862-4474-8352-aa4768804cad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f82a2-c560-4f99-b0c0-3dc185c875cf]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:32 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad Sep 05 21:10:32 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:32 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 1073741824" returned: 0 in 0.501s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:32 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 Sep 05 21:10:32 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:32 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad" returned: 0 in 0.469s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:32 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a Sep 05 21:10:32 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:32 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299" returned: 0 in 0.319s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50a2535-6748-4c44-b4be-55de9bb06046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3505c49e-beb9-4622-a179-ae61bf0b1299', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8800f03-7ff5-4c03-8d62-db07fed88e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:32 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Volume volume-3505c49e-beb9-4622-a179-ae61bf0b1299 (3505c49e-beb9-4622-a179-ae61bf0b1299): created successfully Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8800f03-7ff5-4c03-8d62-db07fed88e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:32 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (b67e15e4-35d1-4359-9bf4-e0af88b25759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:32 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e8fe2004-859a-466c-93a3-267cd68d0b39 tempest-ProjectReaderTests-168536386 None] Created volume successfully. Sep 05 21:10:33 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" returned: 0 in 0.437s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:33 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a Sep 05 21:10:33 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:33 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:33 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad.4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" returned: 0 in 0.308s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-4d183f08-93a5-4ea6-ae0b-7d9da5675b4a" released by "_delete_snapshot" :: held 1.737s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3ddbaa13-a862-4474-8352-aa4768804cad" released by "delete_snapshot" :: held 1.768s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:33 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Created reservations ['227ccb56-9cd3-40e8-91a8-1a267895d612', '6e8b7dab-fbe6-4af9-9da7-df39eeb4b607', '4c4973ea-ba7e-46d0-8f19-7652b46f246d', '7b22a8c6-a09d-4ff7-846b-e3c185c097e5'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:33 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:10:33 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-44772b5d-96b3-4663-9089-8f890ddcc5db tempest-ProjectMemberTests-1286767482 None] Lock "cinder-4d183f08-93a5-4ea6-ae0b-7d9da5675b4a-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-3ddbaa13-a862-4474-8352-aa4768804cad-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-3ddbaa13-a862-4474-8352-aa4768804cad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-3ddbaa13-a862-4474-8352-aa4768804cad" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3ddbaa13-a862-4474-8352-aa4768804cad" acquired by "delete_volume" :: waited 0.030s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f761357-617e-4cd9-b7dd-d1959798f394]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Creating offline snapshot 068adf1e-736b-44b9-ac46-bb2cf785f4f0 of volume 3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cbe983-c04a-48f1-90dc-646a1186ea17]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:34 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad Sep 05 21:10:34 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:34 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 Sep 05 21:10:34 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:34 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad" returned: 0 in 0.435s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:34 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad Sep 05 21:10:34 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:34 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299" returned: 0 in 0.432s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:34 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 1G Sep 05 21:10:34 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:34 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3ddbaa13-a862-4474-8352-aa4768804cad" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3ddbaa13-a862-4474-8352-aa4768804cad" released by "delete_volume" :: held 0.766s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:34 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Created reservations ['c3cabbad-b7d2-4e25-a87b-294c7acda05e', '187fcb70-7cd5-4a17-9cf6-8ce3804c32d4', '147d82e1-d71e-4cff-9910-5af418b8b4a5', '52652df0-56cd-45b9-874f-742919f0c731'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:35 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:35 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:35 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 1G" returned: 0 in 0.462s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3505c49e-beb9-4622-a179-ae61bf0b1299 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:35 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3505c49e-beb9-4622-a179-ae61bf0b1299 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 Sep 05 21:10:35 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:35 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.298s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:35 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ce6c728f-a2b3-4d6b-943a-7e68466d2a48 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-3ddbaa13-a862-4474-8352-aa4768804cad-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:35 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3505c49e-beb9-4622-a179-ae61bf0b1299 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0" returned: 0 in 0.378s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:35 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 is being set with open permissions: ugo+rw Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:35 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 Sep 05 21:10:35 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (ea8c0fa1-008c-480a-aba3-75fbb0679d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee337f8-53de-4905-9084-2161450e43a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee337f8-53de-4905-9084-2161450e43a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628549561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f646bc87-7979-4f55-bffa-a7d8f53e19ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:36Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fd484c-810f-4627-960c-3f48f668a3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:35 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fd484c-810f-4627-960c-3f48f668a3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516e296b-70bc-43b5-adcf-bedf546af0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516e296b-70bc-43b5-adcf-bedf546af0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f646bc87-7979-4f55-bffa-a7d8f53e19ca', 'volume_name': 'volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b031bfd-3078-4de2-8ea3-9d3eae0961f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b031bfd-3078-4de2-8ea3-9d3eae0961f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de12b21c-f26e-4e29-9261-f51049d7f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:35 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Volume f646bc87-7979-4f55-bffa-a7d8f53e19ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca', 'volume_size': 1} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:35 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0" returned: 0 in 0.474s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:36 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.info Sep 05 21:10:36 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:36 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.info" returned: 0 in 0.291s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:36 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.info is being set with open permissions: ugo+rw Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:36 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.info Sep 05 21:10:36 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:36 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.info" returned: 0 in 0.295s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628549561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f646bc87-7979-4f55-bffa-a7d8f53e19ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:36Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Creating volume f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:36 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:36 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:36 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca 1073741824 Sep 05 21:10:36 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:36 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-022bdc09-2247-467a-9efb-014b90bebcae tempest-ProjectReaderTests-168536386 None] Create snapshot completed successfully Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-068adf1e-736b-44b9-ac46-bb2cf785f4f0-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:37 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca 1073741824" returned: 0 in 0.616s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Lock "cinder-068adf1e-736b-44b9-ac46-bb2cf785f4f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-3505c49e-beb9-4622-a179-ae61bf0b1299" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-3505c49e-beb9-4622-a179-ae61bf0b1299" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-068adf1e-736b-44b9-ac46-bb2cf785f4f0" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-068adf1e-736b-44b9-ac46-bb2cf785f4f0" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Deleting offline snapshot 068adf1e-736b-44b9-ac46-bb2cf785f4f0 of volume 3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:37 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca Sep 05 21:10:37 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] snapshot_file for this snap is: volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b2944-b869-4ee0-822a-77ae2d095db9]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:37 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 Sep 05 21:10:37 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:37 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca" returned: 0 in 0.408s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de12b21c-f26e-4e29-9261-f51049d7f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9dd87-eb19-4d68-869c-56e397350d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:37 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Volume volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca (f646bc87-7979-4f55-bffa-a7d8f53e19ca): created successfully Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec9dd87-eb19-4d68-869c-56e397350d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (ea8c0fa1-008c-480a-aba3-75fbb0679d66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:37 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5b8589ee-0816-45a9-8e98-bd702622e6c7 tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:10:37 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0" returned: 0 in 0.462s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3505c49e-beb9-4622-a179-ae61bf0b1299(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[554407ac-e34d-44c9-9985-45c19b077051]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:37 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:38 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 Sep 05 21:10:38 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 5cacdaf4-49a3-4ab2-a6e3-8a5601306644 of volume f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[49888e6c-b8be-4d0e-9932-24b56230efe2]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:38 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299" returned: 0 in 0.430s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:38 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 Sep 05 21:10:38 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:38 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca Sep 05 21:10:38 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:38 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca" returned: 0 in 0.480s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:38 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0" returned: 0 in 0.480s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:38 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:38 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 1G Sep 05 21:10:38 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:38 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0 Sep 05 21:10:38 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:39 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299.068adf1e-736b-44b9-ac46-bb2cf785f4f0" returned: 0 in 0.289s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-068adf1e-736b-44b9-ac46-bb2cf785f4f0" released by "_delete_snapshot" :: held 1.791s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-3505c49e-beb9-4622-a179-ae61bf0b1299" released by "delete_snapshot" :: held 1.848s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Created reservations ['d13c066e-b5cf-48dd-8d39-36fff99794f8', 'dbc407db-582f-4c0a-8237-023db090f802', '07eef51b-e857-4b11-bdbc-c7a528aced61', 'e426b3b4-9156-4e75-8716-c2bf5f8d1465'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:39 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Delete snapshot completed successfully. Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8a8b7d84-6dd2-47ef-970b-6c384dfb7f3c tempest-ProjectReaderTests-168536386 None] Lock "cinder-068adf1e-736b-44b9-ac46-bb2cf785f4f0-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:39 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 1G" returned: 0 in 0.582s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:39 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 Sep 05 21:10:39 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-3505c49e-beb9-4622-a179-ae61bf0b1299-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Lock "cinder-3505c49e-beb9-4622-a179-ae61bf0b1299-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-3505c49e-beb9-4622-a179-ae61bf0b1299" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-3505c49e-beb9-4622-a179-ae61bf0b1299" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a80e0f-f49d-4dc2-9cd5-958aa34bc01f]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:39 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644" returned: 0 in 0.370s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:39 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 is being set with open permissions: ugo+rw Sep 05 21:10:39 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:39 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 Sep 05 21:10:39 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:39 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 Sep 05 21:10:39 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:40 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644" returned: 0 in 0.313s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:40 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299" returned: 0 in 0.477s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:40 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.info Sep 05 21:10:40 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:40 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299 Sep 05 21:10:40 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:40 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.info" returned: 0 in 0.291s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:40 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.info is being set with open permissions: ugo+rw Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:40 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.info Sep 05 21:10:40 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:40 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-3505c49e-beb9-4622-a179-ae61bf0b1299" returned: 0 in 0.319s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-3505c49e-beb9-4622-a179-ae61bf0b1299" released by "delete_volume" :: held 0.892s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Created reservations ['e868866b-9d06-43ff-965f-d50d968cb670', '9ffb2a00-db36-4fd7-a335-9603db043906', '04cb108a-c5cf-488f-9863-73a8a458b9bf', '54157856-8107-41c4-8b87-ac88082c8ab1'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:40 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:40 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:40 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.info" returned: 0 in 0.310s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:40 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:40 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a13d4cf4-1451-400e-a669-315355c88dc0 tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:10:41 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.449s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:41 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Deleted volume successfully. Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-ed32405b-4945-40ae-99c8-b69d0667e61f tempest-ProjectReaderTests-168536386 None] Lock "cinder-3505c49e-beb9-4622-a179-ae61bf0b1299-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (000e068f-c86f-4ed8-9019-b027f11d1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8fa6e4-21b5-4d8e-b666-3eeab51308b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-5cacdaf4-49a3-4ab2-a6e3-8a5601306644-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-5cacdaf4-49a3-4ab2-a6e3-8a5601306644-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-f646bc87-7979-4f55-bffa-a7d8f53e19ca" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8fa6e4-21b5-4d8e-b666-3eeab51308b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470888632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e3729b-deef-47c3-b5b4-952b8238a600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:41Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b507b3-738d-460b-8a7b-3202bc3f6b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b507b3-738d-460b-8a7b-3202bc3f6b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffafc1e5-ae27-4f84-be5f-03b2965c6533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffafc1e5-ae27-4f84-be5f-03b2965c6533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e3729b-deef-47c3-b5b4-952b8238a600', 'volume_name': 'volume-06e3729b-deef-47c3-b5b4-952b8238a600', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07836712-cc6d-40d8-829f-81118cef4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07836712-cc6d-40d8-829f-81118cef4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb54976b-cc08-433e-ac8b-ba8bb7ca543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:41 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Volume 06e3729b-deef-47c3-b5b4-952b8238a600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e3729b-deef-47c3-b5b4-952b8238a600', 'volume_size': 1} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470888632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e3729b-deef-47c3-b5b4-952b8238a600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:41Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Creating volume 06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:41 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-f646bc87-7979-4f55-bffa-a7d8f53e19ca" acquired by "delete_snapshot" :: waited 0.104s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-5cacdaf4-49a3-4ab2-a6e3-8a5601306644" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:41 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 1073741824 Sep 05 21:10:41 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-5cacdaf4-49a3-4ab2-a6e3-8a5601306644" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 5cacdaf4-49a3-4ab2-a6e3-8a5601306644 of volume f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb8185-d3c9-4373-bb40-5d5732baa6a5]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:41 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:41 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 Sep 05 21:10:41 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:42 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644" returned: 0 in 0.420s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea12243e-52c2-4166-9e32-8220da3c9a92]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:42 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 1073741824" returned: 0 in 0.611s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:42 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 Sep 05 21:10:42 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:42 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca Sep 05 21:10:42 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:42 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600" returned: 0 in 0.354s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb54976b-cc08-433e-ac8b-ba8bb7ca543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e3729b-deef-47c3-b5b4-952b8238a600', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33206ec-dc74-41cb-93a4-334559f5226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:42 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Volume volume-06e3729b-deef-47c3-b5b4-952b8238a600 (06e3729b-deef-47c3-b5b4-952b8238a600): created successfully Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33206ec-dc74-41cb-93a4-334559f5226f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (000e068f-c86f-4ed8-9019-b027f11d1591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:42 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5f03abd3-8a62-4bcd-a6bd-370184a8a1d3 tempest-ProjectReaderTests-168536386 None] Created volume successfully. Sep 05 21:10:42 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca" returned: 0 in 0.558s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:42 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:42 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 Sep 05 21:10:42 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:43 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644" returned: 0 in 0.378s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:43 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644 Sep 05 21:10:43 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:43 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca.5cacdaf4-49a3-4ab2-a6e3-8a5601306644" returned: 0 in 0.345s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-5cacdaf4-49a3-4ab2-a6e3-8a5601306644" released by "_delete_snapshot" :: held 1.867s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-f646bc87-7979-4f55-bffa-a7d8f53e19ca" released by "delete_snapshot" :: held 1.907s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Created reservations ['8e16a455-982e-460a-a3ff-a2f39537244f', '5be924e1-8053-436d-b036-124e988a636f', 'c64482c9-cbd5-42ad-b4c0-7edcf415779f', '07cf7661-5fb7-4197-ab88-71e5bf2cea0b'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:43 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Creating offline snapshot d6bfc07d-253c-4c07-be7a-c17f8ff80947 of volume 06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-65a37fca-9607-48dc-ba23-7d8260362830 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-5cacdaf4-49a3-4ab2-a6e3-8a5601306644-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e915f7-6f6a-44a4-90cf-df734532e390]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:43 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:43 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 Sep 05 21:10:43 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:44 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:44 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 1G Sep 05 21:10:44 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:44 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 1G" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e3729b-deef-47c3-b5b4-952b8238a600 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:44 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e3729b-deef-47c3-b5b4-952b8238a600 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 Sep 05 21:10:44 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-f646bc87-7979-4f55-bffa-a7d8f53e19ca-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Lock "cinder-f646bc87-7979-4f55-bffa-a7d8f53e19ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-f646bc87-7979-4f55-bffa-a7d8f53e19ca" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-f646bc87-7979-4f55-bffa-a7d8f53e19ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[981a7134-978a-4eef-90ce-8b93c6dcd3ad]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:44 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e3729b-deef-47c3-b5b4-952b8238a600 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947" returned: 0 in 0.323s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:44 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 is being set with open permissions: ugo+rw Sep 05 21:10:44 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:44 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 Sep 05 21:10:44 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:45 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca Sep 05 21:10:45 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:45 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947" returned: 0 in 0.286s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:45 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.info Sep 05 21:10:45 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:45 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca" returned: 0 in 0.433s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:45 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca Sep 05 21:10:45 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:45 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.info" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:45 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.info is being set with open permissions: ugo+rw Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:45 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.info Sep 05 21:10:45 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:45 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-f646bc87-7979-4f55-bffa-a7d8f53e19ca" returned: 0 in 0.255s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-f646bc87-7979-4f55-bffa-a7d8f53e19ca" released by "delete_volume" :: held 0.742s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Created reservations ['f0b18312-ac2f-4c59-a90e-229b1b210807', 'd41b396e-143a-4c27-8c0e-2c8b38e2743f', 'fcb2fa50-5680-4a83-b6a8-ab9ba7684807', '34603314-fc56-45c6-a66e-971f2951c910'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:45 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:45 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:45 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.info" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-27a7f18f-4114-42d2-8beb-585c622517bc tempest-ProjectReaderTests-168536386 None] Create snapshot completed successfully Sep 05 21:10:45 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:45 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:45 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7aef5df3-2cd7-4ee8-a72d-057ce6ae81ce tempest-ProjectMemberTests-1286767482 None] Lock "cinder-f646bc87-7979-4f55-bffa-a7d8f53e19ca-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (55d4b94d-0de3-4d88-8f3d-cd1b7398568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5263c20-ece6-4066-aa32-edd6103f6be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5263c20-ece6-4066-aa32-edd6103f6be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476571291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5649586-5072-48af-b590-adb5babf1d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:46Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed004a2-f7e3-4775-bf0f-3ed6cf18e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed004a2-f7e3-4775-bf0f-3ed6cf18e47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44092878-8b88-4bd6-a458-30f4057c5d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44092878-8b88-4bd6-a458-30f4057c5d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5649586-5072-48af-b590-adb5babf1d48', 'volume_name': 'volume-c5649586-5072-48af-b590-adb5babf1d48', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c2aa0d-46bf-4a43-82e5-32c7ef2aa7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c2aa0d-46bf-4a43-82e5-32c7ef2aa7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db656a9-4189-4e7f-9dc5-d87215b8c2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:46 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Volume c5649586-5072-48af-b590-adb5babf1d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5649586-5072-48af-b590-adb5babf1d48', 'volume_size': 1} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1476571291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5649586-5072-48af-b590-adb5babf1d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:46Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Creating volume c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:46 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:46 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 1073741824 Sep 05 21:10:46 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:46 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 1073741824" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-d6bfc07d-253c-4c07-be7a-c17f8ff80947-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Lock "cinder-d6bfc07d-253c-4c07-be7a-c17f8ff80947-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-06e3729b-deef-47c3-b5b4-952b8238a600" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:46 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 Sep 05 21:10:46 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-06e3729b-deef-47c3-b5b4-952b8238a600" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-d6bfc07d-253c-4c07-be7a-c17f8ff80947" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-d6bfc07d-253c-4c07-be7a-c17f8ff80947" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Deleting offline snapshot d6bfc07d-253c-4c07-be7a-c17f8ff80947 of volume 06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:46 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] snapshot_file for this snap is: volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[77500016-9da2-44c9-a38d-97a372b4d541]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:47 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 Sep 05 21:10:47 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:47 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db656a9-4189-4e7f-9dc5-d87215b8c2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5649586-5072-48af-b590-adb5babf1d48', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcd7d05-2056-47ed-8455-ad91bab4b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:47 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Volume volume-c5649586-5072-48af-b590-adb5babf1d48 (c5649586-5072-48af-b590-adb5babf1d48): created successfully Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bcd7d05-2056-47ed-8455-ad91bab4b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (55d4b94d-0de3-4d88-8f3d-cd1b7398568f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:47 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-52b09dba-0462-431f-86ee-5a45610de4b1 tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:10:47 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947" returned: 0 in 0.378s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06e3729b-deef-47c3-b5b4-952b8238a600(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3cff52-56f0-4452-909a-532bd7cb2f08]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:47 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 Sep 05 21:10:47 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 3f33edee-aab7-4ca1-bf80-169f18f42a12 of volume c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[0834ab22-0dd9-4c3a-8dbd-0440c3318f8d]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:47 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 Sep 05 21:10:47 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:47 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:47 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 Sep 05 21:10:47 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:47 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48" returned: 0 in 0.385s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:47 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:48 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 1G Sep 05 21:10:48 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:48 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947" returned: 0 in 0.352s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:48 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947 Sep 05 21:10:48 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:48 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:48 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 1G" returned: 0 in 0.395s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5649586-5072-48af-b590-adb5babf1d48 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600.d6bfc07d-253c-4c07-be7a-c17f8ff80947" returned: 0 in 0.261s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:48 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5649586-5072-48af-b590-adb5babf1d48 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 Sep 05 21:10:48 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-d6bfc07d-253c-4c07-be7a-c17f8ff80947" released by "_delete_snapshot" :: held 1.450s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-06e3729b-deef-47c3-b5b4-952b8238a600" released by "delete_snapshot" :: held 1.471s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Created reservations ['ab54f264-d504-46a2-9f7c-e2502555e197', '0ed14ca3-5ee9-47ed-ae01-9853813b8083', '0b201cdd-6b45-494b-9b66-d2e0b4de351b', '2b399fef-ffe8-4912-bff8-e44f8359d423'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:48 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Delete snapshot completed successfully. Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-cf7135ab-1a95-4e65-bc2e-f224f3c892d4 tempest-ProjectReaderTests-168536386 None] Lock "cinder-d6bfc07d-253c-4c07-be7a-c17f8ff80947-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:48 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5649586-5072-48af-b590-adb5babf1d48 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12" returned: 0 in 0.293s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:48 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 is being set with open permissions: ugo+rw Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:48 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 Sep 05 21:10:48 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:48 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12" returned: 0 in 0.239s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:48 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:48 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.info Sep 05 21:10:48 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-06e3729b-deef-47c3-b5b4-952b8238a600-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Lock "cinder-06e3729b-deef-47c3-b5b4-952b8238a600-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-06e3729b-deef-47c3-b5b4-952b8238a600" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-06e3729b-deef-47c3-b5b4-952b8238a600" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e77032f-3d48-40c7-9c5e-af9b33d11c27]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:49 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.info" returned: 0 in 0.268s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:49 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.info is being set with open permissions: ugo+rw Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:49 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.info Sep 05 21:10:49 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:49 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 Sep 05 21:10:49 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:49 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.info" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:49 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-78f03f2e-68ab-4f9f-9498-b3a4ed9efc1a tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:10:49 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600" returned: 0 in 0.359s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:49 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600 Sep 05 21:10:49 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-3f33edee-aab7-4ca1-bf80-169f18f42a12-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-3f33edee-aab7-4ca1-bf80-169f18f42a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-c5649586-5072-48af-b590-adb5babf1d48" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-c5649586-5072-48af-b590-adb5babf1d48" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-3f33edee-aab7-4ca1-bf80-169f18f42a12" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3f33edee-aab7-4ca1-bf80-169f18f42a12" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 3f33edee-aab7-4ca1-bf80-169f18f42a12 of volume c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad60d8-195c-437c-83fa-408317dc7c36]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:49 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-06e3729b-deef-47c3-b5b4-952b8238a600" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-06e3729b-deef-47c3-b5b4-952b8238a600" released by "delete_volume" :: held 0.677s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Created reservations ['23e58c0f-c190-472f-a120-46e6b1bcdfe1', 'c4021446-f4bc-4fec-b088-2d972b3122d8', 'ff9df64f-d82e-49b9-afa2-20a010715799', 'ad4f0db9-2d04-46a0-bb8d-8f5f55a20465'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:49 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 Sep 05 21:10:49 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:49 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:49 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:49 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:50 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5649586-5072-48af-b590-adb5babf1d48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e297ae-7f9a-4249-9f27-36e62cc7a2ec]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:50 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:50 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Deleted volume successfully. Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-0e29d4d6-bd93-4cd0-bcc1-1c9cb521d35d tempest-ProjectReaderTests-168536386 None] Lock "cinder-06e3729b-deef-47c3-b5b4-952b8238a600-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:50 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 Sep 05 21:10:50 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:50 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48" returned: 0 in 0.379s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:50 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 Sep 05 21:10:50 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (9d381525-b028-40bd-b734-d7137d219ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8965d324-1a67-41dd-a2da-156d0bd4b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8965d324-1a67-41dd-a2da-156d0bd4b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338109481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6216b1-f1f4-415f-a84c-0a83fccf1cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:51Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b674fca7-5567-4924-9063-d43096e4fc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b674fca7-5567-4924-9063-d43096e4fc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabba822-aff2-4c15-874e-c3b47afe8c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabba822-aff2-4c15-874e-c3b47afe8c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6216b1-f1f4-415f-a84c-0a83fccf1cd2', 'volume_name': 'volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5e58e5-9089-45a0-94a0-0bdde57ba727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5e58e5-9089-45a0-94a0-0bdde57ba727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4df4d7e-0a0d-4d34-b231-14eb04b8a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:50 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Volume 9f6216b1-f1f4-415f-a84c-0a83fccf1cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2', 'volume_size': 1} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1338109481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6216b1-f1f4-415f-a84c-0a83fccf1cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672d85368148483f9f79ea841083378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:51Z,use_quota=True,user_id='92045a43ede94d649c63be2eb1576c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Creating volume 9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:50 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:50 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 1073741824 Sep 05 21:10:50 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:50 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12" returned: 0 in 0.347s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:50 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:50 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12 Sep 05 21:10:50 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:51 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48.3f33edee-aab7-4ca1-bf80-169f18f42a12" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-3f33edee-aab7-4ca1-bf80-169f18f42a12" released by "_delete_snapshot" :: held 1.473s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-c5649586-5072-48af-b590-adb5babf1d48" released by "delete_snapshot" :: held 1.496s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:51 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 1073741824" returned: 0 in 0.427s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Created reservations ['64eecbf8-dc20-47d8-b445-582da1b66f85', '7c4fa215-b5d1-414f-9891-8fc1a1504933', 'a3dd5ba0-caf5-406d-8a3b-e0c11b29145e', '95b5e541-27d1-4136-869c-f0919a5b8605'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:51 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 Sep 05 21:10:51 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-e85a7b3f-f389-47bc-8ced-e551614c6289 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-3f33edee-aab7-4ca1-bf80-169f18f42a12-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:51 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4df4d7e-0a0d-4d34-b231-14eb04b8a43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023b924c-e818-4eb9-97a3-ea049a1334ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:51 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Volume volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 (9f6216b1-f1f4-415f-a84c-0a83fccf1cd2): created successfully Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023b924c-e818-4eb9-97a3-ea049a1334ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Flow 'volume_create_manager' (9d381525-b028-40bd-b734-d7137d219ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:51 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c2d83a38-b0ff-4b4f-a3f6-b809ccbb6bb7 tempest-ProjectReaderTests-168536386 None] Created volume successfully. Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-c5649586-5072-48af-b590-adb5babf1d48-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-c5649586-5072-48af-b590-adb5babf1d48-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Creating offline snapshot 4e529b17-726a-49a3-9199-b96055a6c4dd of volume 9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c7d9c0-d049-4d78-93e5-38c81945ee70]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-c5649586-5072-48af-b590-adb5babf1d48" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:51 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-c5649586-5072-48af-b590-adb5babf1d48" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa03b1a-0e97-4061-9cb0-2145ba05774c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:52 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 Sep 05 21:10:52 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:52 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 Sep 05 21:10:52 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:52 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" returned: 0 in 0.371s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:52 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd 1G Sep 05 21:10:52 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:52 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48" returned: 0 in 0.389s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:52 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48 Sep 05 21:10:52 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:52 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-c5649586-5072-48af-b590-adb5babf1d48" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-c5649586-5072-48af-b590-adb5babf1d48" released by "delete_volume" :: held 0.705s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:52 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd 1G" returned: 0 in 0.402s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Created reservations ['321e2a44-4ab1-430c-88c3-3aefa31f1f49', '0980fe3f-503d-4f31-9334-fcd61ab4c556', '4c58905f-b870-4f53-ae35-b77b4461f7e2', '2435c5b8-0de7-4133-bfee-991f734ec595'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:52 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd Sep 05 21:10:52 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:52 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:52 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:52 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:53 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd" returned: 0 in 0.327s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:53 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd is being set with open permissions: ugo+rw Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:53 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd Sep 05 21:10:53 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:53 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.269s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-f0f7e8be-9cfa-45c2-9cc8-f91ad0060a5f tempest-ProjectMemberTests-1286767482 None] Lock "cinder-c5649586-5072-48af-b590-adb5babf1d48-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:53 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd" returned: 0 in 0.265s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:53 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.info Sep 05 21:10:53 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (68c9c177-178d-42f0-b8b2-203914f107c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068894ec-cc53-41ad-a5d5-54936161c26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068894ec-cc53-41ad-a5d5-54936161c26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569171067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570ea4d1-e4e9-4fea-9441-da21d1c5b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:53Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4092d3-0241-4af0-a0f2-eba31ba5a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4092d3-0241-4af0-a0f2-eba31ba5a68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aeb102-6a52-4fdb-a889-5306598cdc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7aeb102-6a52-4fdb-a889-5306598cdc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570ea4d1-e4e9-4fea-9441-da21d1c5b660', 'volume_name': 'volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c72798-3fbf-4e52-98f6-ebf7a37195a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c72798-3fbf-4e52-98f6-ebf7a37195a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3e5f1c-d9b6-4685-8de6-259ef1bf3974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:53 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Volume 570ea4d1-e4e9-4fea-9441-da21d1c5b660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660', 'volume_size': 1} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:53 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.info" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:53 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.info is being set with open permissions: ugo+rw Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:53 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.info Sep 05 21:10:53 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:53 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.info" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.290s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569171067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570ea4d1-e4e9-4fea-9441-da21d1c5b660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:10:53Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Creating volume 570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:10:53 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:10:53 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:53 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 1073741824 Sep 05 21:10:53 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:53 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-903a66ac-2ef8-4d55-b485-bd04269aebd6 tempest-ProjectReaderTests-168536386 None] Create snapshot completed successfully Sep 05 21:10:54 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 1073741824" returned: 0 in 0.426s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:54 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 Sep 05 21:10:54 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:54 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3e5f1c-d9b6-4685-8de6-259ef1bf3974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56568c1c-394d-4255-800c-5ac7e5a27ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:10:54 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Volume volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 (570ea4d1-e4e9-4fea-9441-da21d1c5b660): created successfully Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56568c1c-394d-4255-800c-5ac7e5a27ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:10:54 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (68c9c177-178d-42f0-b8b2-203914f107c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:10:54 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-38001d24-d54a-42de-912c-5896f7f57c1c tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-4e529b17-726a-49a3-9199-b96055a6c4dd-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Lock "cinder-4e529b17-726a-49a3-9199-b96055a6c4dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-4e529b17-726a-49a3-9199-b96055a6c4dd" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-4e529b17-726a-49a3-9199-b96055a6c4dd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Deleting offline snapshot 4e529b17-726a-49a3-9199-b96055a6c4dd of volume 9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] snapshot_file for this snap is: volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb0f97b-f887-408d-9cf9-21fc5789024a]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:55 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd Sep 05 21:10:55 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:55 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd" returned: 0 in 0.356s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[943632be-c72a-482c-843e-34a2f3266051]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:55 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 Sep 05 21:10:55 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 9019fc01-4809-4ea5-93ab-9a9065769720 of volume 570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dcdd81-d3e9-4946-928f-94fcab12c0d1]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:55 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 Sep 05 21:10:55 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:55 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" returned: 0 in 0.376s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:55 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:55 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd Sep 05 21:10:55 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:56 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660" returned: 0 in 0.386s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:56 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 1G Sep 05 21:10:56 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:56 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd" returned: 0 in 0.350s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:56 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd Sep 05 21:10:56 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:56 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2.4e529b17-726a-49a3-9199-b96055a6c4dd" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-4e529b17-726a-49a3-9199-b96055a6c4dd" released by "_delete_snapshot" :: held 1.418s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" released by "delete_snapshot" :: held 1.442s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:56 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 1G" returned: 0 in 0.394s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:56 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 Sep 05 21:10:56 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Created reservations ['9410ee4a-3fad-479c-9ee9-d7e5898a5473', '13e21965-8f0d-4278-9454-675e032b98a5', 'fd0d1b42-0db3-4f5e-b790-b76c13788b80', 'f48e2267-7638-4188-a45f-493adceeb885'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:56 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Delete snapshot completed successfully. Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-741843aa-103d-4e67-9628-9374368f2c7a tempest-ProjectReaderTests-168536386 None] Lock "cinder-4e529b17-726a-49a3-9199-b96055a6c4dd-delete_snapshot" released by "delete_snapshot" :: held 1.599s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:56 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720" returned: 0 in 0.281s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:56 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 is being set with open permissions: ugo+rw Sep 05 21:10:56 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:56 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 Sep 05 21:10:56 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:57 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:57 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.info Sep 05 21:10:57 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Lock "cinder-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Acquiring lock "cinder-quobyte-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da3fc9-42f5-4454-b6cc-97738de1b3eb]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:57 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.info" returned: 0 in 0.270s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:57 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.info is being set with open permissions: ugo+rw Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:57 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.info Sep 05 21:10:57 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:57 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 Sep 05 21:10:57 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:57 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.info" returned: 0 in 0.265s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:57 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" returned: 0 in 0.371s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:57 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-cf992a76-34a5-4bb1-aab0-8d64684e93d9 tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:10:57 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2 Sep 05 21:10:57 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-9019fc01-4809-4ea5-93ab-9a9065769720-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Lock "cinder-9019fc01-4809-4ea5-93ab-9a9065769720-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-570ea4d1-e4e9-4fea-9441-da21d1c5b660" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-570ea4d1-e4e9-4fea-9441-da21d1c5b660" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-9019fc01-4809-4ea5-93ab-9a9065769720" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-9019fc01-4809-4ea5-93ab-9a9065769720" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:10:57 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 9019fc01-4809-4ea5-93ab-9a9065769720 of volume 570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" returned: 0 in 0.278s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c255491-0050-4d8e-bde7-344517736117]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:57 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Lock "cinder-quobyte-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2" released by "delete_volume" :: held 0.709s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Created reservations ['b0f7536c-1c2e-4490-9388-8aa48ce0cee9', '0d5026ad-db11-4a85-bc98-e43b891f97d0', 'e332f405-4d6e-4f0a-91a0-74e8683d484c', '6c56ff66-38b4-4cc5-b99d-b8b55e2be208'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:10:58 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 Sep 05 21:10:58 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:58 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:10:58 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:58 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.251s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:10:58 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Deleted volume successfully. Sep 05 21:10:58 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720" returned: 0 in 0.395s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5e329b6b-af44-4758-978a-93a5e703ce27 tempest-ProjectReaderTests-168536386 None] Lock "cinder-9f6216b1-f1f4-415f-a84c-0a83fccf1cd2-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff850133-a27f-4a99-9443-29843050371b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:58 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 Sep 05 21:10:58 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:58 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660" returned: 0 in 0.370s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:58 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:58 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 Sep 05 21:10:58 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:59 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720" returned: 0 in 0.360s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:10:59 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720 Sep 05 21:10:59 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:10:59 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660.9019fc01-4809-4ea5-93ab-9a9065769720" returned: 0 in 0.268s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-9019fc01-4809-4ea5-93ab-9a9065769720" released by "_delete_snapshot" :: held 1.509s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-570ea4d1-e4e9-4fea-9441-da21d1c5b660" released by "delete_snapshot" :: held 1.532s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=188,cinder:INSERT=60,cinder:UPDATE=243,cinder:DELETE=16 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:UPDATE=224,cinder:SELECT=184,cinder:INSERT=75,cinder:DELETE=24 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Created reservations ['0351bcee-4f5b-46da-b78c-7f599fa9ae6b', 'c0a0e81e-55bb-47fd-a79c-f28a5ea6544d', '6822560b-878f-488c-96a6-73f9fc691331', '86ec9ce7-9451-4891-bffe-1fe0438c2131'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:10:59 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:10:59 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-8baf6016-8bae-42bb-8f9c-45586e686d5b tempest-ProjectMemberTests-1286767482 None] Lock "cinder-9019fc01-4809-4ea5-93ab-9a9065769720-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-570ea4d1-e4e9-4fea-9441-da21d1c5b660-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-570ea4d1-e4e9-4fea-9441-da21d1c5b660-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-570ea4d1-e4e9-4fea-9441-da21d1c5b660" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-570ea4d1-e4e9-4fea-9441-da21d1c5b660" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[5147f299-cd8f-4199-af6e-5ada3c724605]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:00 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 Sep 05 21:11:00 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:00 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660" returned: 0 in 0.361s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:00 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660 Sep 05 21:11:00 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:00 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-570ea4d1-e4e9-4fea-9441-da21d1c5b660" returned: 0 in 0.248s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-570ea4d1-e4e9-4fea-9441-da21d1c5b660" released by "delete_volume" :: held 0.672s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Created reservations ['0394b387-e0a9-4172-9ac5-7ff4181bd62d', 'e0fa5a36-ffd5-467d-bfdc-8245a6c12f0f', 'c2049980-d77c-4875-b57a-90a807a8b027', 'c7138a30-431e-41f7-b96b-d2ab904b4a66'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:00 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:00 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:00 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:01 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:01 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-7d82674b-c50e-49a9-960a-e8ad5ab4c374 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-570ea4d1-e4e9-4fea-9441-da21d1c5b660-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (c328003d-a0c1-46cc-ab75-c19a40c6bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb7e880-3609-499a-b1de-9e97f6a10e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb7e880-3609-499a-b1de-9e97f6a10e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863606548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c0849c-25e3-49c8-84a0-2cfc65768745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:02Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37675370-af60-406b-9a8f-2cf582b9354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37675370-af60-406b-9a8f-2cf582b9354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331a87d9-e0fa-4917-a51e-3b9e71116a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331a87d9-e0fa-4917-a51e-3b9e71116a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c0849c-25e3-49c8-84a0-2cfc65768745', 'volume_name': 'volume-36c0849c-25e3-49c8-84a0-2cfc65768745', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ca5d6f-78c0-4eca-9820-db8582058030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ca5d6f-78c0-4eca-9820-db8582058030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2140eb-353a-4b1a-825d-67e18d98309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:01 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Volume 36c0849c-25e3-49c8-84a0-2cfc65768745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c0849c-25e3-49c8-84a0-2cfc65768745', 'volume_size': 1} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863606548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c0849c-25e3-49c8-84a0-2cfc65768745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbd3f06937af450899730631193502b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:02Z,use_quota=True,user_id='6402883369ca4885854c1712971c0b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Creating volume 36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:11:01 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:11:01 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:01 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 1073741824 Sep 05 21:11:01 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:02 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 1073741824" returned: 0 in 0.446s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:02 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 Sep 05 21:11:02 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:02 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745" returned: 0 in 0.257s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2140eb-353a-4b1a-825d-67e18d98309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c0849c-25e3-49c8-84a0-2cfc65768745', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aad4b51-5eea-46a0-8fef-2fc60f69566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:02 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Volume volume-36c0849c-25e3-49c8-84a0-2cfc65768745 (36c0849c-25e3-49c8-84a0-2cfc65768745): created successfully Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aad4b51-5eea-46a0-8fef-2fc60f69566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Flow 'volume_create_manager' (c328003d-a0c1-46cc-ab75-c19a40c6bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:02 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-38555484-dd7d-48e9-84f7-4bd560405edf tempest-ProjectMemberTests-1286767482 None] Created volume successfully. Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Creating offline snapshot 44773cf8-4b8e-4740-98be-d633af5123ff of volume 36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[217eb924-125a-4990-979e-b9f709bde680]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:02 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:03 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 Sep 05 21:11:03 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:03 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745" returned: 0 in 0.371s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff 1G {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:03 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff 1G Sep 05 21:11:03 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:03 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff 1G" returned: 0 in 0.409s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c0849c-25e3-49c8-84a0-2cfc65768745 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:03 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c0849c-25e3-49c8-84a0-2cfc65768745 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff Sep 05 21:11:03 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:03 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c0849c-25e3-49c8-84a0-2cfc65768745 -F qcow2 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff" returned: 0 in 0.307s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:03 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff is being set with open permissions: ugo+rw Sep 05 21:11:03 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:04 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff Sep 05 21:11:04 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:04 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff" returned: 0 in 0.245s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:04 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.info Sep 05 21:11:04 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:04 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.info" returned: 0 in 0.288s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:04 devstack cinder-volume[87778]: WARNING cinder.volume.drivers.remotefs [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.info is being set with open permissions: ugo+rw Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.info {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:04 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.info Sep 05 21:11:04 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:04 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.info" returned: 0 in 0.249s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:04 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-e8db7819-b9d6-48c8-ba0f-ca72fe9578cd tempest-ProjectMemberTests-1286767482 None] Create snapshot completed successfully Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:04 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:04 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:04 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-44773cf8-4b8e-4740-98be-d633af5123ff-delete_snapshot" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Lock "cinder-44773cf8-4b8e-4740-98be-d633af5123ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-36c0849c-25e3-49c8-84a0-2cfc65768745" by "delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-36c0849c-25e3-49c8-84a0-2cfc65768745" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-44773cf8-4b8e-4740-98be-d633af5123ff" by "_delete_snapshot" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-44773cf8-4b8e-4740-98be-d633af5123ff" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Deleting offline snapshot 44773cf8-4b8e-4740-98be-d633af5123ff of volume 36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 05 21:11:05 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] snapshot_file for this snap is: volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff {{(pid=87778) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.303s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo_service.periodic_task [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] Running periodic task VolumeManager._thread_info {{(pid=87778) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread count: 28 {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c9c5f178-965e-435e-9b3d-c83135f0f73c None None] thread info: [<_MainThread(MainThread, started 130671469912192)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87778) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dec59ee-754d-4a42-9344-2de6cd632ae4]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:05 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff Sep 05 21:11:05 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:05 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff" returned: 0 in 0.363s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c0849c-25e3-49c8-84a0-2cfc65768745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87778) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ea360-a5d8-4fd3-85d0-429c18ceea4c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:05 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 Sep 05 21:11:05 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:05 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745" returned: 0 in 0.357s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:05 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:06 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff Sep 05 21:11:06 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:06 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff" returned: 0 in 0.327s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:06 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff Sep 05 21:11:06 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:06 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745.44773cf8-4b8e-4740-98be-d633af5123ff" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-44773cf8-4b8e-4740-98be-d633af5123ff" released by "_delete_snapshot" :: held 1.421s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-36c0849c-25e3-49c8-84a0-2cfc65768745" released by "delete_snapshot" :: held 1.455s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Created reservations ['e1f5f6b6-f269-4099-9164-7f60607d1b37', '35d34c57-82b8-4078-8ea3-72f570ecc427', '3da98218-7801-4fe4-a9f6-202142de0796', '6ea2a739-61e2-4f87-bc0e-2ff93ed7d2d6'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (95dc51e4-5d1d-4818-b2c1-7e5da81c648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0669f954-59ac-4804-89c4-7da79045505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0669f954-59ac-4804-89c4-7da79045505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2125035672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff14f768-c853-492c-8680-36ad72f5ded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:07Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee0f429-564d-412c-b532-31e1ea63ceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee0f429-564d-412c-b532-31e1ea63ceca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4411849-dc2b-45bf-bb77-1d0526d8db08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4411849-dc2b-45bf-bb77-1d0526d8db08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff14f768-c853-492c-8680-36ad72f5ded7', 'volume_name': 'volume-ff14f768-c853-492c-8680-36ad72f5ded7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e07254-669a-4717-bb66-2e910f262d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42e07254-669a-4717-bb66-2e910f262d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f0b6d3-1f00-4698-81ef-91b8a1184953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:06 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Volume ff14f768-c853-492c-8680-36ad72f5ded7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff14f768-c853-492c-8680-36ad72f5ded7', 'volume_size': 1} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2125035672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff14f768-c853-492c-8680-36ad72f5ded7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:07Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Creating volume ff14f768-c853-492c-8680-36ad72f5ded7 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:11:06 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:06 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 1073741824 Sep 05 21:11:06 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:06 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Delete snapshot completed successfully. Sep 05 21:11:06 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-2254c6a7-ef35-433a-8a64-777c74351e2d tempest-ProjectMemberTests-1286767482 None] Lock "cinder-44773cf8-4b8e-4740-98be-d633af5123ff-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:07 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 1073741824" returned: 0 in 0.410s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:07 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 Sep 05 21:11:07 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-36c0849c-25e3-49c8-84a0-2cfc65768745-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-36c0849c-25e3-49c8-84a0-2cfc65768745-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "cinder-quobyte-36c0849c-25e3-49c8-84a0-2cfc65768745" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-36c0849c-25e3-49c8-84a0-2cfc65768745" acquired by "delete_volume" :: waited 0.013s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb82ae-e9a4-476e-9a96-7e69a97c2d4b]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:07 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:07 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 Sep 05 21:11:07 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f0b6d3-1f00-4698-81ef-91b8a1184953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff14f768-c853-492c-8680-36ad72f5ded7', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fa419f-3d78-4fb3-8ed1-99566050d0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:07 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Volume volume-ff14f768-c853-492c-8680-36ad72f5ded7 (ff14f768-c853-492c-8680-36ad72f5ded7): created successfully Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12fa419f-3d78-4fb3-8ed1-99566050d0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (95dc51e4-5d1d-4818-b2c1-7e5da81c648f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:07 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-8385cccd-63e1-4104-9fae-e44ac3840357 tempest-ProjectReaderTests-414784745 None] Created volume successfully. Sep 05 21:11:07 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745" returned: 0 in 0.366s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:07 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745 Sep 05 21:11:07 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-ff14f768-c853-492c-8680-36ad72f5ded7-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Lock "cinder-ff14f768-c853-492c-8680-36ad72f5ded7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-quobyte-ff14f768-c853-492c-8680-36ad72f5ded7" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-ff14f768-c853-492c-8680-36ad72f5ded7" acquired by "delete_volume" :: waited 0.014s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c932a6-3764-4b93-9bdf-3fe6e125d411]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:07 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:08 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-36c0849c-25e3-49c8-84a0-2cfc65768745" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-quobyte-36c0849c-25e3-49c8-84a0-2cfc65768745" released by "delete_volume" :: held 0.686s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:08 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 Sep 05 21:11:08 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Created reservations ['240330a7-ad08-4f0a-99eb-1f5764ef670e', '0e68bc9a-d4cc-49b8-b3de-a08913ba47e7', '4fa8cf29-8304-44f3-ad03-70873e66aa5e', '86def27c-ca3b-4a5b-87f1-b6a02f58ee5c'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:08 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:08 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:08 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7" returned: 0 in 0.360s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:08 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7 Sep 05 21:11:08 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:08 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.284s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:08 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Deleted volume successfully. Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-a4daebcd-f6dc-4244-885b-a26d4167cef4 tempest-ProjectMemberTests-1286767482 None] Lock "cinder-36c0849c-25e3-49c8-84a0-2cfc65768745-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:08 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ff14f768-c853-492c-8680-36ad72f5ded7" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-ff14f768-c853-492c-8680-36ad72f5ded7" released by "delete_volume" :: held 0.658s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Created reservations ['6238655f-668e-4b10-bfdb-51babcfffdf2', 'de4e9130-4322-4e21-8643-fcab923c51e5', 'e3dd500d-a1e3-4cd2-ba57-700c300bfc00', 'a44ab0a1-1e4b-435c-8afb-14dd6811ec76'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:08 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:08 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:08 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.252s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:08 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:08 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Deleted volume successfully. Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-423de820-d931-4fb4-ba7d-be388168b399 tempest-ProjectReaderTests-414784745 None] Lock "cinder-ff14f768-c853-492c-8680-36ad72f5ded7-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (e90444c3-54cd-478c-8b71-1eca055fdf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150a183c-9d80-4cdd-8dcb-3affb559372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (150a183c-9d80-4cdd-8dcb-3affb559372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223487762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb4596e-9d74-4a92-a3e6-fd7047a9369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:09Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf67c3f9-54c2-4c60-bb14-5eabdc64cc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf67c3f9-54c2-4c60-bb14-5eabdc64cc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b7b2a6-0815-40e3-aaa0-d909522961ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b7b2a6-0815-40e3-aaa0-d909522961ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb4596e-9d74-4a92-a3e6-fd7047a9369b', 'volume_name': 'volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a55c0e9-96c2-4a39-ad70-63bcce6ea8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a55c0e9-96c2-4a39-ad70-63bcce6ea8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64623a0a-47c2-45e1-a81c-a4adc47f8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:09 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Volume eeb4596e-9d74-4a92-a3e6-fd7047a9369b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b', 'volume_size': 1} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1223487762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb4596e-9d74-4a92-a3e6-fd7047a9369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:09Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Creating volume eeb4596e-9d74-4a92-a3e6-fd7047a9369b {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:11:09 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:11:09 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:09 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b 1073741824 Sep 05 21:11:09 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:10 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b 1073741824" returned: 0 in 0.440s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:10 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b Sep 05 21:11:10 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:10 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b" returned: 0 in 0.258s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64623a0a-47c2-45e1-a81c-a4adc47f8237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0b412-ee9d-41c5-be09-a2cb5f6c3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:10 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Volume volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b (eeb4596e-9d74-4a92-a3e6-fd7047a9369b): created successfully Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e0b412-ee9d-41c5-be09-a2cb5f6c3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (e90444c3-54cd-478c-8b71-1eca055fdf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:10 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-75cb6485-d58f-445a-8830-56ebae98458f tempest-ProjectReaderTests-414784745 None] Created volume successfully. Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-eeb4596e-9d74-4a92-a3e6-fd7047a9369b-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Lock "cinder-eeb4596e-9d74-4a92-a3e6-fd7047a9369b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-quobyte-eeb4596e-9d74-4a92-a3e6-fd7047a9369b" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-eeb4596e-9d74-4a92-a3e6-fd7047a9369b" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdfe686-803b-4423-b6bf-da5483b26536]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:10 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:10 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b Sep 05 21:11:10 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:11 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b" returned: 0 in 0.372s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:11 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b Sep 05 21:11:11 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:11 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-eeb4596e-9d74-4a92-a3e6-fd7047a9369b" returned: 0 in 0.248s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-eeb4596e-9d74-4a92-a3e6-fd7047a9369b" released by "delete_volume" :: held 0.662s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Created reservations ['43681013-25f8-4fcd-9eb2-3a854694290d', '714f5c0c-2ddc-4d23-badc-bba9f3ff8118', '9409256f-14d1-43b6-8f49-f2feca0d2052', '8a192c79-0ec8-4e14-9f3a-f7e07f0f25d3'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:11 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:11 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:11 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.262s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:11 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Deleted volume successfully. Sep 05 21:11:11 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-c9a99422-81b3-447d-90e1-b0dc4d5fdcc3 tempest-ProjectReaderTests-414784745 None] Lock "cinder-eeb4596e-9d74-4a92-a3e6-fd7047a9369b-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (da400e14-3d9a-4644-aaaf-92c31f02ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c44749-849b-40b0-a2fd-b58343d1274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c44749-849b-40b0-a2fd-b58343d1274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927082308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4910482-7ede-4ec5-abec-3dea5622f3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:12Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de02f10c-9182-49fc-814f-f8f1f9f41dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de02f10c-9182-49fc-814f-f8f1f9f41dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726a2b67-b04f-457b-9861-e02381bab470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726a2b67-b04f-457b-9861-e02381bab470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4910482-7ede-4ec5-abec-3dea5622f3c8', 'volume_name': 'volume-e4910482-7ede-4ec5-abec-3dea5622f3c8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcacf19-a48b-41fc-9cd9-b9f5c0768e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcacf19-a48b-41fc-9cd9-b9f5c0768e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2484d63a-d573-4629-9a8d-9da05feb1668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Volume e4910482-7ede-4ec5-abec-3dea5622f3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4910482-7ede-4ec5-abec-3dea5622f3c8', 'volume_size': 1} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927082308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4910482-7ede-4ec5-abec-3dea5622f3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:12Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Creating volume e4910482-7ede-4ec5-abec-3dea5622f3c8 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:11:12 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:12 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 1073741824 Sep 05 21:11:12 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Flow 'volume_create_manager' (bb301a50-a178-465e-a7c0-80b0f24a7baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a7ba47-6d7a-4bf6-bb5a-1c5c1247dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a7ba47-6d7a-4bf6-bb5a-1c5c1247dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235391975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe9c8d8-f938-46eb-99a7-40bf39fc3d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4349a74f914454aa2383aa19ca9394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:12Z,use_quota=True,user_id='14df5530f87349fd84d04b4ccf6f0f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5013e8-4449-45be-b72c-482a32d59acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5013e8-4449-45be-b72c-482a32d59acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c750d2-64f4-4ba0-9a4c-9c1fce440d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c750d2-64f4-4ba0-9a4c-9c1fce440d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe9c8d8-f938-46eb-99a7-40bf39fc3d31', 'volume_name': 'volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c18e897-86a8-4bc4-be18-e65748d1e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c18e897-86a8-4bc4-be18-e65748d1e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d005a0b5-eb93-48a4-9238-8427b99215b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:12 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Volume ebe9c8d8-f938-46eb-99a7-40bf39fc3d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31', 'volume_size': 1} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:12 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 1073741824" returned: 0 in 0.405s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:12 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:12 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 Sep 05 21:11:12 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:13 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8" returned: 0 in 0.243s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235391975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe9c8d8-f938-46eb-99a7-40bf39fc3d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4349a74f914454aa2383aa19ca9394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:12Z,use_quota=True,user_id='14df5530f87349fd84d04b4ccf6f0f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Creating volume ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:11:13 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2484d63a-d573-4629-9a8d-9da05feb1668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4910482-7ede-4ec5-abec-3dea5622f3c8', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:13 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 1073741824 Sep 05 21:11:13 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c9b566-3201-4a74-a79a-d273b975fe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:13 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Volume volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 (e4910482-7ede-4ec5-abec-3dea5622f3c8): created successfully Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c9b566-3201-4a74-a79a-d273b975fe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (da400e14-3d9a-4644-aaaf-92c31f02ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-96241031-a607-48a8-a42b-f864be4c1f51 tempest-ProjectReaderTests-414784745 None] Created volume successfully. Sep 05 21:11:13 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 1073741824" returned: 0 in 0.413s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:13 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 Sep 05 21:11:13 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:13 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31" returned: 0 in 0.237s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d005a0b5-eb93-48a4-9238-8427b99215b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97927e5-6729-4003-8040-693be0d7359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:13 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Volume volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 (ebe9c8d8-f938-46eb-99a7-40bf39fc3d31): created successfully Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97927e5-6729-4003-8040-693be0d7359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:13 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Flow 'volume_create_manager' (bb301a50-a178-465e-a7c0-80b0f24a7baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:13 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-a70b4f75-d4da-48b8-bd86-f6baee4a2c1e tempest-ProjectReaderTests-394701924 None] Created volume successfully. Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-e4910482-7ede-4ec5-abec-3dea5622f3c8-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Lock "cinder-e4910482-7ede-4ec5-abec-3dea5622f3c8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-quobyte-e4910482-7ede-4ec5-abec-3dea5622f3c8" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-e4910482-7ede-4ec5-abec-3dea5622f3c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b450d9a-85ff-4ac4-9520-870b253b137c]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Acquiring lock "cinder-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Lock "cinder-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Acquiring lock "cinder-quobyte-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Lock "cinder-quobyte-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e4d634-abf7-46c8-bcad-a35c6436b6dd]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:14 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 Sep 05 21:11:14 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:14 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 Sep 05 21:11:14 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:14 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8" returned: 0 in 0.373s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:14 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8 Sep 05 21:11:14 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:14 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31" returned: 0 in 0.373s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:14 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:14 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31 Sep 05 21:11:14 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:15 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e4910482-7ede-4ec5-abec-3dea5622f3c8" returned: 0 in 0.253s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-e4910482-7ede-4ec5-abec-3dea5622f3c8" released by "delete_volume" :: held 0.672s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Created reservations ['94b38004-fe66-419e-a209-10937302f129', 'fd06250e-7b70-448e-ba65-163d3b9147e3', '557c68ed-edaf-44ac-a2e2-ab1e8374e339', '34ac5b7d-e69b-4909-bdaa-ba38d45abf91'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:15 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31" returned: 0 in 0.256s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Lock "cinder-quobyte-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31" released by "delete_volume" :: held 0.667s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:15 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:15 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Created reservations ['38a792bb-ae8c-4df1-9fa2-8ad7864fe35c', '73a8d51f-a746-4bae-8766-7eefdcc01da3', 'f4188184-f8f9-4fd6-9743-ee19bdfdc3d9', '0479b5c7-e48b-4383-a31a-6bd7d365954a'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:15 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:15 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:15 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.263s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Deleted volume successfully. Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-483593b0-6ed5-428a-83a6-51fae89c6063 tempest-ProjectReaderTests-414784745 None] Lock "cinder-e4910482-7ede-4ec5-abec-3dea5622f3c8-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:15 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.280s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:15 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Deleted volume successfully. Sep 05 21:11:15 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-5ff983d4-fc64-4db1-88bc-845a91f8b489 tempest-ProjectReaderTests-394701924 None] Lock "cinder-ebe9c8d8-f938-46eb-99a7-40bf39fc3d31-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (c9a13497-8264-4329-8d9d-6e139e205f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9941a08e-85db-4bf4-807a-fc73de5c4fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9941a08e-85db-4bf4-807a-fc73de5c4fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755789418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed3195d-091a-4823-82f0-15f5b2fbbb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:16Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9c0b71-703c-4a4d-bc22-9c0610f5f5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9c0b71-703c-4a4d-bc22-9c0610f5f5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c813569-44fa-420a-b6b4-f0a1a6f96b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c813569-44fa-420a-b6b4-f0a1a6f96b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed3195d-091a-4823-82f0-15f5b2fbbb83', 'volume_name': 'volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f89a641-9939-47c3-a9f1-fcf8cd4ab808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f89a641-9939-47c3-a9f1-fcf8cd4ab808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d75dbcd-824e-4a2e-a8ee-b8e3222c8149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Volume 9ed3195d-091a-4823-82f0-15f5b2fbbb83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83', 'volume_size': 1} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755789418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed3195d-091a-4823-82f0-15f5b2fbbb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee686f2ecb2840749e396d99cd1e9306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:16Z,use_quota=True,user_id='bf8c58993d0d4f7a963f38fa84cd3daa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Creating volume 9ed3195d-091a-4823-82f0-15f5b2fbbb83 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:11:16 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87778) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 05 21:11:16 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 1073741824 Sep 05 21:11:16 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Flow 'volume_create_manager' (58171a1b-a2ca-4d4b-8ac3-dd38e2725633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df972d39-8ebb-45fe-a363-fc81e6d5be92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df972d39-8ebb-45fe-a363-fc81e6d5be92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807438990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490bf90-ed9e-4c2a-9dba-dac2f434c192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4349a74f914454aa2383aa19ca9394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:16Z,use_quota=True,user_id='14df5530f87349fd84d04b4ccf6f0f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a82847-b724-4ffe-9750-06419f7c38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a82847-b724-4ffe-9750-06419f7c38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea3115b-4f7c-490d-a227-01ccbf8fd2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea3115b-4f7c-490d-a227-01ccbf8fd2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e490bf90-ed9e-4c2a-9dba-dac2f434c192', 'volume_name': 'volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da64f23-2d60-4ab6-85b4-6855a368ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da64f23-2d60-4ab6-85b4-6855a368ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983d5fa4-c0d3-4ca9-bfcf-acb7e8a77776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Volume e490bf90-ed9e-4c2a-9dba-dac2f434c192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192', 'volume_size': 1} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:16 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 1073741824" returned: 0 in 0.408s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:16 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 Sep 05 21:11:16 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:16 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83" returned: 0 in 0.244s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-05T19:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807438990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e490bf90-ed9e-4c2a-9dba-dac2f434c192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f4349a74f914454aa2383aa19ca9394',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-05T19:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-05T19:11:16Z,use_quota=True,user_id='14df5530f87349fd84d04b4ccf6f0f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8),volume_type_id=1cf56be8-1b85-4d7b-9ea3-4b3dee5601c8)}" {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.remotefs [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Creating volume e490bf90-ed9e-4c2a-9dba-dac2f434c192 {{(pid=87778) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Selected osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 as target Quobyte volume. {{(pid=87778) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Sep 05 21:11:16 devstack cinder-volume[87778]: INFO cinder.volume.drivers.remotefs [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] casted to osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361 Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 1073741824 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d75dbcd-824e-4a2e-a8ee-b8e3222c8149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:16 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 1073741824 Sep 05 21:11:16 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d53feba-0195-4e73-8ad8-fb8310c04cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:16 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Volume volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 (9ed3195d-091a-4823-82f0-15f5b2fbbb83): created successfully Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d53feba-0195-4e73-8ad8-fb8310c04cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Flow 'volume_create_manager' (c9a13497-8264-4329-8d9d-6e139e205f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-c88e8b2b-abf7-409d-84ef-e4113b424083 tempest-ProjectReaderTests-414784745 None] Created volume successfully. Sep 05 21:11:17 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 1073741824" returned: 0 in 0.439s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:17 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 Sep 05 21:11:17 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:17 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'} {{(pid=87778) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983d5fa4-c0d3-4ca9-bfcf-acb7e8a77776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192', 'volume_size': 1}' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee5bea3-4af1-43ef-bf84-3fc6ede0acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 05 21:11:17 devstack cinder-volume[87778]: INFO cinder.volume.flows.manager.create_volume [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Volume volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 (e490bf90-ed9e-4c2a-9dba-dac2f434c192): created successfully Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee5bea3-4af1-43ef-bf84-3fc6ede0acf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87778) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 05 21:11:17 devstack cinder-volume[87778]: DEBUG cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Flow 'volume_create_manager' (58171a1b-a2ca-4d4b-8ac3-dd38e2725633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87778) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 05 21:11:17 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-93c5d219-0814-47ec-aa2a-731a3782fde0 tempest-ProjectReaderTests-394701924 None] Created volume successfully. Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-9ed3195d-091a-4823-82f0-15f5b2fbbb83-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Lock "cinder-9ed3195d-091a-4823-82f0-15f5b2fbbb83-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Acquiring lock "cinder-quobyte-9ed3195d-091a-4823-82f0-15f5b2fbbb83" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-9ed3195d-091a-4823-82f0-15f5b2fbbb83" acquired by "delete_volume" :: waited 0.017s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1f9e91-e56c-4974-a948-65525c8f14f3]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:18 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 Sep 05 21:11:18 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Acquiring lock "cinder-e490bf90-ed9e-4c2a-9dba-dac2f434c192-delete_volume" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Lock "cinder-e490bf90-ed9e-4c2a-9dba-dac2f434c192-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Acquiring lock "cinder-quobyte-e490bf90-ed9e-4c2a-9dba-dac2f434c192" by "delete_volume" {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Lock "cinder-quobyte-e490bf90-ed9e-4c2a-9dba-dac2f434c192" acquired by "delete_volume" :: waited 0.013s {{(pid=87778) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0242d1-be63-4e86-88bb-b684751f0684]: (4, 'qcow2') {{(pid=89112) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:18 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83" returned: 0 in 0.375s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:18 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83 Sep 05 21:11:18 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:18 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 Sep 05 21:11:18 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:18 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-9ed3195d-091a-4823-82f0-15f5b2fbbb83" returned: 0 in 0.246s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Lock "cinder-quobyte-9ed3195d-091a-4823-82f0-15f5b2fbbb83" released by "delete_volume" :: held 0.657s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Created reservations ['95c57f7d-b1d2-4f60-8baa-cf981256a0e9', 'b17dfb90-5f17-482b-ad62-6f5075913cb4', '5454ba40-9f8e-4f91-ac8e-060f623fcf9c', '1e992eef-63af-4ba1-95df-2ccc3e5d9004'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:18 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192" returned: 0 in 0.367s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:18 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192 Sep 05 21:11:18 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:18 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:19 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:19 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:19 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a/volume-e490bf90-ed9e-4c2a-9dba-dac2f434c192" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Lock "cinder-quobyte-e490bf90-ed9e-4c2a-9dba-dac2f434c192" released by "delete_volume" :: held 0.670s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.quota [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Created reservations ['83119636-43b6-4b42-a4c5-2f63a660e3de', '86b5b110-9ea3-4d3e-8b58-52454ae88545', 'd83afeca-85bf-4174-98d8-a761b8e0a9ba', '8ed99036-d053-4493-8425-732b8f063feb'] {{(pid=87778) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 05 21:11:19 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.264s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:19 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Deleted volume successfully. Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-93eb0211-35cd-4510-9229-23dd5934535b tempest-ProjectReaderTests-414784745 None] Lock "cinder-9ed3195d-091a-4823-82f0-15f5b2fbbb83-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361': None} {{(pid=87778) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.volume.drivers.quobyte [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e61fca0d-9083-4feb-871e-bb90cb0df361'] {{(pid=87778) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.lockutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87778) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 05 21:11:19 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a Sep 05 21:11:19 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 05 21:11:19 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG oslo_concurrency.processutils [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ab52160e9678eb7d26ee5d587bf4854a" returned: 0 in 0.259s {{(pid=87778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.manager [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Notifying Schedulers of capabilities ... {{(pid=87778) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 05 21:11:19 devstack cinder-volume[87778]: INFO cinder.volume.manager [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Deleted volume successfully. Sep 05 21:11:19 devstack cinder-volume[87778]: DEBUG cinder.coordination [None req-b9460b16-64e7-44f2-9c78-c3db281daf37 tempest-ProjectReaderTests-394701924 None] Lock "cinder-e490bf90-ed9e-4c2a-9dba-dac2f434c192-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87778) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 05 21:11:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=63,cinder:INSERT=22,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 05 21:11:36 devstack cinder-volume[87778]: DEBUG dbcounter [-] [87778] Writing DB stats cinder:SELECT=67,cinder:INSERT=26,cinder:UPDATE=98,cinder:DELETE=10 {{(pid=87778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}